ikiruneo/millionaire-bench

Python tool for automated evaluation of generation

Inspect: A framework for large language model evaluations

The Universe of Evaluation. All about the evaluation for LLMs.

Evaluate your LLM's response with Prometheus and GPT4 💯

LLM Council works together to answer your hardest questions

LiveBench: A Challenging, Contamination-Free LLM Benchmark

Simple LLM Evaluation Using LLM As a Judge 👩‍⚖️

Automated system for LLM evaluation via agents. Doc as below:

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.