DaoyuanLi2816/pairjudge

Open source LLM arena created by the French Government

Auditing LLM-as-judge systems with paired synthetic controls, bootstrap CIs, and BH-FDR bias detection.

One-shot LLM eval cases by NAGI STUDIO - same prompt, different agents (model + harness), runnable artifacts side by side.

Simple LLM Evaluation Using LLM As a Judge 👩‍⚖️

EvalAssist is an open-source project that simplifies using large language models as evaluators (LLM-as-a-Judge) of the output of other large language models by supporting users in iteratively refining evaluation criteria in a web-based user experience.

discover LLMs punching above their weight

Evals that meet you where you are. For AI that's grounded.

RewardBench: the first evaluation tool for reward models.

Evaluate your LLM's response with Prometheus and GPT4 💯