raga-ai-hub/RagaAI-Catalyst

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

AI Observability & Evaluation

The LLM Evaluation Framework

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

Build and run agents you can see, understand and trust.

Supercharge Your LLM Application Evaluations 🚀

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.