rajshah4/LLM-Evaluation

Data-Driven Evaluation for LLM-Powered Applications

Supercharge Your LLM Application Evaluations 🚀

The LLM Evaluation Framework

A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use cases, promote the adoption of best practices in LLM assessment, and critically assess the effectiveness of these evaluation methods.

Skills for AI Evals to compliment the course: AI Evals For Engineers & PMs

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Inspect: A framework for large language model evaluations

RAG evaluation without the need for "golden answers"

🐢 Open-Source Evaluation & Testing library for LLM Agents