🐢 Open-Source Evaluation & Testing library for LLM Agents
Like Giskard-AI/giskard-oss, 0 likes 0 Bookmark Giskard-AI/giskard-oss, 0 bookmarks 0 Toolkit for AI whitehats, internal red teams, llm bug bounty hunters and mlops - Adversarial testing for AI, LLMs, and Agents.
Like airtasystems/Genbounty-LLM-Hunter-Community-Free, 0 likes 0 Bookmark airtasystems/Genbounty-LLM-Hunter-Community-Free, 0 bookmarks 0 Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪
Like msoedov/agentic_security, 0 likes 0 Bookmark msoedov/agentic_security, 0 bookmarks 0 Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, and structured output. Supports vLLM, SGLang, and llama.cpp.
Like SeraphimSerapis/tool-eval-bench, 0 likes 0 Bookmark SeraphimSerapis/tool-eval-bench, 0 bookmarks 0 rook by TestMu AI: Agent Assurance from the terminal. Test how your AI agents actually behave across workflows, tools, and actions, and catch failures and vulnerabilities before they ship.
Like LambdaTest/rook, 0 likes 0 Bookmark LambdaTest/rook, 0 bookmarks 0 LLM evals to test open-source inference providers
Like synthetic-lab/synbad, 0 likes 0 Bookmark synthetic-lab/synbad, 0 bookmarks 0 Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
Like promptfoo/promptfoo, 0 likes 0 Bookmark promptfoo/promptfoo, 0 bookmarks 0 A comprehensive evaluation framework for AI agents and LLM applications.
Like strands-agents/evals, 0 likes 0 Bookmark strands-agents/evals, 0 bookmarks 0 The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.
Like JudgmentLabs/judgeval, 0 likes 0 Bookmark JudgmentLabs/judgeval, 0 bookmarks 0 
