vectara/open-rag-eval

A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data

Supercharge Your LLM Application Evaluations 🚀

Tools for evaluation of RAG Chat Apps using Azure AI Evaluate SDK and OpenAI

Open-source tool to visualise your RAG 🔮

Unified benchmark for evaluating conversational memory and RAG across multiple datasets

RAG LLM Ops App for easy deployment and testing

Skills for AI Evals to compliment the course: AI Evals For Engineers & PMs

Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.

Data-Driven Evaluation for LLM-Powered Applications