stanford-crfm/helm

A framework for few-shot evaluation of language models.

A unified evaluation framework for large language models

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

LiveBench: A Challenging, Contamination-Free LLM Benchmark

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

The LLM Evaluation Framework

Framework for evaluating and improving agents