BerriAI/litellm
在全部 GitHub 仓库 中按Star排名第 34（共 803）
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
项目介绍
Open Source AI Gateway for 100+ LLMs. Self-hosted. Enterprise-ready. Call any LLM in OpenAI format.
LiteLLM is an open source AI Gateway that gives you a single, unified interface to call 100+ LLM providers — OpenAI, Anthropic, Gemini, Bedrock, Azure, and more — using the OpenAI format.
Use it as a Python SDK for direct library integration, or deploy the AI Gateway (Proxy Server) as a centralized service for your team or organization.
Jump to LiteLLM Proxy (LLM Gateway) Docs Jump to Supported LLM Providers
Managing LLM calls across providers gets complicated fast — different SDKs, auth patterns, request formats, and error types for every model. LiteLLM removes that friction:
LLMs -…
最新指标
| Star | 58.5k | 2026-09-12 |
|---|---|---|
| Fork | 11.4k | 2026-09-12 |
| 提交 | 48.6k | 2026-09-12 |
| 发布 | 1.0k | 2026-09-12 |
| Watcher | 233 | 2026-09-12 |
| 开放 issue | 1.7k | 2026-09-12 |
| 开放 PR | 3.3k | 2026-09-12 |