McGill-NLP/instruct-qa

Evaluate your LLM's response with Prometheus and GPT4 💯

xVerify: Efficient Answer Verifier for Reasoning Model Evaluations

Inspect: A framework for large language model evaluations

bloom - evaluate any behavior immediately  🌸🌱

Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".

Readymade evaluators for your LLM apps

Unified benchmark for evaluating conversational memory and RAG across multiple datasets

Open-Domain Question Answering Goes Conversational via Question Rewriting

Evaluating LLMs with Dynamic Data