google-deepmind/eval_hub

Evaluate your LLM's response with Prometheus and GPT4 💯

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

😎 Awesome list about Gemma, Google DeepMind's family of lightweights, state-of-the-art open models.

Collection of evals for Inspect AI

OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

The Universe of Evaluation. All about the evaluation for LLMs.

Every Eval Ever is a shared schema and crowdsourced eval database. It defines a standardized metadata format for storing AI evaluation results — from leaderboard scrapes and research papers to local evaluation runs — so that results from different frameworks can be compared, reproduced, and reused.

Inspect: A framework for large language model evaluations

Simple LLM Evaluation Using LLM As a Judge 👩‍⚖️