TIGER-AI-Lab/MMLU-Pro

LLM Arena by KCORES team

A benchmark to evaluate language models on questions I've previously asked them to solve.

LiveBench: A Challenging, Contamination-Free LLM Benchmark

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"

A unified evaluation framework for large language models

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

A framework for few-shot evaluation of language models.

A benchmark for evaluating LLMs on open-ended CS problems. Exploring the Next Frontier of Computer Science.