langchain-ai/openevals

Inspect: A framework for large language model evaluations

Evaluate your LLM's response with Prometheus and GPT4 💯

Supercharge Your LLM Application Evaluations 🚀

Data-Driven Evaluation for LLM-Powered Applications

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

bloom - evaluate any behavior immediately  🌸🌱

Skills for AI Evals to compliment the course: AI Evals For Engineers & PMs

The LLM Evaluation Framework

AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.