OpenDCAI/One-Eval

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

The Universe of Evaluation. All about the evaluation for LLMs.

Inspect: A framework for large language model evaluations

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

The LLM Evaluation Framework

bloom - evaluate any behavior immediately  🌸🌱

Evaluate your LLM's response with Prometheus and GPT4 💯

Provider-agnostic, open-source evaluation infrastructure for language models

Readymade evaluators for your LLM apps