RouteShift normalizes twelve LLM providers behind a single OpenAI-compatible API. You bring the credentials; the proxy handles auth shape, header conventions, and response decoding.Documentation Index
Fetch the complete documentation index at: https://docs.axiomancer.io/llms.txt
Use this file to discover all available pages before exploring further.
Catalog
| Provider | Auth shape | Notes |
|---|---|---|
| OpenAI | Authorization: Bearer | Direct passthrough. |
| Anthropic | x-api-key | Anthropic Messages API. |
| API key | Gemini family. | |
| AWS Bedrock | SigV4 | Configure access_key_id + region in the provider key’s metadata jsonb. |
| Azure OpenAI | API key | Configure resource_name + api_version in metadata. |
| Together | Authorization: Bearer | OpenAI-compatible. |
| Groq | Authorization: Bearer | OpenAI-compatible, very low latency. |
| Z.ai (Zhipu GLM) | Authorization: Bearer | OpenAI-compatible. |
| Xiaomi MiMo | API key | Custom auth header, OpenAI-compatible body. |
| MiniMax | x-api-key or Bearer | Anthropic-compatible. |
| Moonshot (Kimi) | x-api-key or Bearer | Anthropic-compatible. |
| Alibaba Qwen (DashScope) | Authorization: Bearer | OpenAI-compatible. |
Provider keys
A provider key is the upstream credential. Add one at Settings → Providers → Add credential. RouteShift encrypts the secret withPROVIDER_KEY_SECRET (AES-GCM at rest) and never returns it after save.
For providers that need extra non-secret config (Bedrock and Azure), the form exposes structured fields that are stored in a metadata jsonb column. Edit them anytime without re-entering the secret.
Multiple keys per provider
You can attach N labeled provider keys for the same provider — one per region, one per OpenAI org, one per Bedrock account. Each key is an independent target for load balancing, with its own RPM/TPM, weight, and cooldown state. Examples:- Two Bedrock credentials in
us-east-1andus-west-2for failover. - A “paid” OpenAI key plus a “trial” key for cost arbitrage.
- Multiple Azure deployments fronting the same model for capacity scaling.
Adding a new provider
The provider abstraction lives inapps/proxy/src/providers/ — see OpenAICompatProvider and AnthropicCompatProvider for the two base shapes, and BedrockProvider / AzureProvider for examples that need richer config. Most regional providers are 50–150 LOC of glue.
If you’d like a provider added that isn’t in the catalog above, open an issue at github.com/smynkr/RouteShift or email support@routeshift.io.