supermemoryai/memorybench

RAG evaluation without the need for "golden answers"

Supercharge Your LLM Application Evaluations 🚀

RAG LLM Ops App for easy deployment and testing

Tools for evaluation of RAG Chat Apps using Azure AI Evaluate SDK and OpenAI

Evaluate your LLM's response with Prometheus and GPT4 💯

bloom - evaluate any behavior immediately  🌸🌱

Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, and structured output. Supports vLLM, SGLang, and llama.cpp.