tidyverse/vitals

Data-Driven Evaluation for LLM-Powered Applications

A complete toolkit for connecting R and LLMs

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Supercharge Your LLM Application Evaluations 🚀

The LLM Evaluation Framework

Next generation LLM evaluation framework powered by Vitest.

Call LLM APIs from R

Inspect: A framework for large language model evaluations

Comprehensive LLM evaluation at scale: A production-ready framework for evaluating large language models across multiple benchmarks.