viteval/viteval

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Automated system for LLM evaluation via agents. Doc as below:

Simple LLM Evaluation Using LLM As a Judge 👩‍⚖️

The Universe of Evaluation. All about the evaluation for LLMs.

The LLM Evaluation Framework

Comprehensive LLM evaluation at scale: A production-ready framework for evaluating large language models across multiple benchmarks.

Supercharge Your LLM Application Evaluations 🚀

Readymade evaluators for your LLM apps

Evaluate your LLM's response with Prometheus and GPT4 💯