UKGovernmentBEIS/inspect_evals

Skills that guide AI coding agents to help you build product-specific AI evals.

Inspect: A framework for large language model evaluations

AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

Evaluate your LLM's response with Prometheus and GPT4 💯

Skills for AI Evals to compliment the course: AI Evals For Engineers & PMs

bloom - evaluate any behavior immediately  🌸🌱

Readymade evaluators for your LLM apps