one2piece2hello/faibench_Frontier_InfraBench

Evaluating frontier models on real-world ai-infra engineering tasks

A benchmark to evaluate language models on questions I've previously asked them to solve.

Open source, clear, transparent, real world llm benchmarks

LLM Arena by KCORES team

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

LiveBench: A Challenging, Contamination-Free LLM Benchmark

Comprehensive LLM evaluation at scale: A production-ready framework for evaluating large language models across multiple benchmarks.

Local-first CLI for benchmarking LLMs on real hardware — quality, speed, reliability, and a real multi-turn agent loop.