tophant-ai/aibeat

🐢 Open-Source Evaluation & Testing library for LLM Agents

A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

DeepTeam is a framework to red team LLMs and AI agents.

the LLM vulnerability scanner

Set of tools to assess and improve LLM security.

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.

Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. Embed safety directly into your app and prove compliance to your customers.