sauravgoel/autosreguard

Open-source gateway for running agents on dedicated inference at scale. Offer an OpenAI-compatible API over your own model deployments, with per-team keys, usage metering, request logging and capacity pinning. 450x less overhead than LiteLLM

Open-source LLM control plane: observe every call, recommend savings, then apply only human-approved, reversible routing.

Open-source infrastructure for the full inference lifecycle: deploy, observe, scale, optimize, and safely release self-hosted models behind one endpoint.

Cost-efficient and pluggable Infrastructure components for GenAI inference

SRE reliability instrumentation for agentic AI — DQR, TIE, HER, AQD

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

Continuous LLM governance monitoring for regulated environments - EU AI Act, GDPR, ANSSI. Self-hosted, profile-driven, no data leaves your infrastructure.

Enterprise-grade Private Model-as-a-Service Platform

A flexible serving framework that delivers efficient and fault-tolerant LLM inference for clustered deployments.