lmarena/arena-rank

A faster, open-license alternative to Microsoft TrueSkill

Every Eval Ever is a shared schema and crowdsourced eval database. It defines a standardized metadata format for storing AI evaluation results — from leaderboard scrapes and research papers to local evaluation runs — so that results from different frameworks can be compared, reproduced, and reused.

Open source LLM arena created by the French Government

RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker

A website for running the aiarena.net ladder.

RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.

Use LLMs for document ranking

Elo algorithm implementation in Python

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.