guardrails-ai/guardrails

A guidance language for controlling large language models.

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

structured outputs for llms

Supercharge Your LLM Application Evaluations 🚀

The LLM Evaluation Framework

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Structured Outputs

Access large language models from the command-line

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.