FreedomIntelligence/Awesome-Rubrics

A banchmark list for evaluation of large language models.

Large Language Model (LLM) Systems Paper List

Awesome paper in LLM Psychometrics and LLM Psychology

EvalAssist is an open-source project that simplifies using large language models as evaluators (LLM-as-a-Judge) of the output of other large language models by supporting users in iteratively refining evaluation criteria in a web-based user experience.

RewardBench: the first evaluation tool for reward models.

The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Sample notebooks and prompts for LLM evaluation