{"info":{"author":"BerriAI","author_email":null,"bugtrack_url":null,"classifiers":[],"description":"
\n
LiteLLM AI Gateway\n
\nOpen Source AI Gateway for 100+ LLMs. Self-hosted. Enterprise-ready. Call any LLM in OpenAI format.
\n \n \nNetflix | \n
| \n | LiteLLM AI Gateway | \nLiteLLM Python SDK | \n
|---|---|---|
| Use Case | \nCentral service (LLM Gateway) to access multiple LLMs | \nUse LiteLLM directly in your Python code | \n
| Who Uses It? | \nGen AI Enablement / ML Platform Teams | \nDevelopers building LLM projects | \n
| Key Features | \nCentralized API gateway with authentication and authorization, multi-tenant cost tracking and spend management per project/user, per-project customization (logging, guardrails, caching), virtual keys for secure access control, admin dashboard UI for monitoring and management | \nDirect Python library integration in your codebase, Router with retry/fallback logic across multiple deployments (e.g. Azure/OpenAI) - Router, application-level load balancing and cost tracking, exception handling with OpenAI-compatible errors, observability callbacks (Lunary, MLflow, Langfuse, etc.) | \n