carlini/yet-another-applied-llm-benchmark

LLM Arena by KCORES team

Code for the paper "Evaluating Large Language Models Trained on Code"

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Inspect: A framework for large language model evaluations

Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024

Provider-agnostic, open-source evaluation infrastructure for language models

LiveBench: A Challenging, Contamination-Free LLM Benchmark

A unified evaluation framework for large language models