tolitius/cupel

Test LLMs on real tasks. Compare models side-by-side.

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Simple LLM Evaluation Using LLM As a Judge 👩‍⚖️

Open source LLM arena created by the French Government

OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.

The Universe of Evaluation. All about the evaluation for LLMs.

Provider-agnostic, open-source evaluation infrastructure for language models

Automated system for LLM evaluation via agents. Doc as below: