betagouv/ComparIA

Open-source, self-hostable LLM arena with model compare, voting, and leaderboards

discover LLMs punching above their weight

OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

Simple LLM Evaluation Using LLM As a Judge 👩‍⚖️

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Test LLMs on real tasks. Compare models side-by-side.

One-shot LLM eval cases by NAGI STUDIO - same prompt, different agents (model + harness), runnable artifacts side by side.

The Universe of Evaluation. All about the evaluation for LLMs.

Provider-agnostic, open-source evaluation infrastructure for language models