Cohere
Description
Cohere is a foundation-model provider. The gateway integrates with the Cohere Chat V2 endpoint at https://api.cohere.com/v2/chat for chat completions and SSE streaming. Authentication uses a bearer token; the gateway does not require any per-gateway configuration for Cohere beyond the BYOK key.
| Feature | Limitation |
|---|---|
| Chat completions | — |
| Streaming responses (SSE) | — |
| Embedding models | Not supported on the chat endpoint. The gateway logs a warning if an embedding model is requested. |
| Web search | Not supported. The gateway returns a typed web_search_not_supported error instead of attempting a search. |
| Tool use | Not effectively supported on this adapter. The OpenAI tool helpers do not match the Cohere response body, so the gateway tool loop does not fire. |
💡 Note: The gateway uses the Cohere Chat V2 endpoint. The Chat V1 endpoint is not used.
BYOK key format
The BYOK value for the cohere provider is a single Cohere API key. The gateway sends the key in the Authorization: Bearer <KEY> header.
Adding the key
The procedure for storing a BYOK key is the same for every provider. See Provider keys (BYOK) for the steps. Select cohere in the Provider drop-down list and paste the API key in the API Key field.