microsoft/benchpress

Cited 83-model x 49-benchmark LLM evaluation matrix with 18 matrix completion methods

Comprehensive LLM evaluation at scale: A production-ready framework for evaluating large language models across multiple benchmarks.

discover LLMs punching above their weight

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

The Universe of Evaluation. All about the evaluation for LLMs.

Benchmark your local LLMs with real evaluation suites. Not vibes - actual scores.

Simple LLM Evaluation Using LLM As a Judge 👩‍⚖️

Test LLMs on real tasks. Compare models side-by-side.

🏎️ Dead-simple LLM benchmarking CLI - latency, cost, and quality metrics