Skip to content

Providers

A provider is an upstream inference service that Myra AI Workspace forwards requests to. A gateway holds the credentials and the provider-specific settings — such as regions, deployments, or base URL overrides — for the providers it uses.

Function

The gateway sits between your applications and the provider. Applications send every request to the gateway with an authentication token; the gateway attaches the stored provider credentials and forwards the request in the wire format the provider expects. Applications never hold provider credentials, and applications that use the unified endpoint switch providers by changing only the model name in the request — or with no change at all when a routing rule redirects the request.

Rules and facts

  • Provider credentials and settings are stored per gateway. Two gateways that bring their own keys for the same upstream service each hold their own credentials for it; self-serve plans use a Myra-managed pooled key instead.
  • For a self-serve plan on the pooled key, the platform keeps you running without any key management on your side: if the active pool key is blocked, the gateway auto-rotates to the next standby key in the pool. If the whole pool is exhausted or the organisation is suspended — a state rotation cannot heal — the gateway fails over to a different vendor's models for self-serve traffic and raises an operational alert, so requests keep succeeding rather than hard-failing.
  • Each provider is reachable via its own native endpoint and via the unified OpenAI-compatible endpoint.
  • The caller addresses a provider directly on a native endpoint, or implicitly through the model name on the unified endpoint. The routing rules of the gateway can redirect a request to a different provider or model, and win when they match.
  • Provider credentials are stored encrypted. See BYOK (provider key vault) for how keys are stored and who can read them.
  • When the circuit breaker is enabled and a provider fails repeatedly, the gateway removes that provider from rotation until it recovers.

See also