Kaggle/kaggle-benchmarks

Open-source library for scalable, reproducible evaluation of AI models and benchmarks.

Collection of evals for Inspect AI

🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data for end-to-end AI benchmarking

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

A framework for running evals against small (and large) models

Evaluate and improve models and agents using environments

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.