Give Developers

  • Azure Access

  • Gemini Access

  • Bedrock Access

  • OpenAI Access

  • Anthropic Access

AI Gateway to provide model access, fallbacks and spend tracking across 100+ LLMs. All in the OpenAI format.

๐Ÿš… LiteLLM

Cost Tracking

Cost Tracking

Batches API

Guardrails

Model Access

Model Access

Budgets

Budgets

LLM Observability

Rate Limiting

Rate Limiting

Prompt Management

Prompt Management

s3 Logging

Pass-Through Endpoints

User

User

User