gkamradt/needle-in-a-haystack

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Inspect: A framework for large language model evaluations

Official repo for "Make Your LLM Fully Utilize the Context"

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

A long-context code retrieval and reproduction benchmark.

The LLM Evaluation Framework

Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".

bloom - evaluate any behavior immediately  🌸🌱

A unified evaluation framework for large language models