IAAR-Shanghai/xVerify

Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"

Open-source AI verification infrastructure for deterministic verification of LLM outputs, tool calls, code, schemas, and agent state before production execution.

Inspect: A framework for large language model evaluations

Readymade evaluators for your LLM apps

Evals that meet you where you are. For AI that's grounded.

AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.

Evaluate your LLM's response with Prometheus and GPT4 💯

Simple LLM Evaluation Using LLM As a Judge 👩‍⚖️

High-performance LLM evaluation framework with parallel API calls — up to 17× faster than sequential tools. Supports box, math, and logit-based evaluation.