zhangxjohn/LLM-Agent-Benchmark-List

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

A curated list of awesome LLM frameworks, libraries and software.

Awesome-LLM: a curated list of Large Language Model

Automated system for LLM evaluation via agents. Doc as below:

LiveBench: A Challenging, Contamination-Free LLM Benchmark

A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use cases, promote the adoption of best practices in LLM assessment, and critically assess the effectiveness of these evaluation methods.

A comprehensive code domain benchmark review of LLM researches.

OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".