BerriAI/litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
Data last synced with GitHub 1 day ago
Python
44k
7.4k
1,442 contributors
last commit 1 day ago
last user commit 1 day ago
Custom license
created over 2 years ago
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues