Local LLM API Intelligent Gateway — Open-source client + Server Open Core model, unified management of multiple LLM Provider channels, providing intelligent routing, session stickiness, cost optimization, full-chain observability, and team collaborative governance.
An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.
Drop-in LLM router and AI gateway speaking OpenAI Chat Completions, OpenAI Responses and Anthropic Messages APIs, with 124 routing strategies across GPT-6 Astra, Claude Opus 5.5, Gemini 4 Argon and Kimi K3.1 Pro, plus budgets, fallbacks, tenant rate limits, idempotency and audit logs.
