agentscope-ai/OpenJudge

Skills that guide AI coding agents to help you build product-specific AI evals.

Readymade evaluators for your LLM apps

The LLM Evaluation Framework

Skills for AI Evals to compliment the course: AI Evals For Engineers & PMs

AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.

An evaluation and evolution tool for Agent Skills.

Supercharge Your LLM Application Evaluations 🚀

The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.