huggingface/lighteval

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

Inspect: A framework for large language model evaluations

A unified evaluation framework for large language models

A framework for few-shot evaluation of language models.

The LLM Evaluation Framework

bloom - evaluate any behavior immediately  🌸🌱

LiveBench: A Challenging, Contamination-Free LLM Benchmark

Supercharge Your LLM Application Evaluations 🚀