taylorai/lm-deluge

Unified batch API for AI providers. Save up to 50% on LLM costs.

Resilient multi-LLM orchestration with in-built failure handing, rate limits, retries, and circuit breaker.

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

High-performance proxy router for LLM APIs with automatic load balancing, rate limiting, and fail2ban protection

Unified interface for interacting with various LLMs hundreds of models, caching, fallback mechanisms, and enhanced reliability.

LLM router with aggressive normalization and stubborn error-handling.

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

A simple, yet handy, LLM gateway.

llm api gateway