ProofAgent-ai/proofagent-harness

Open-source agent eval platform for real-world tasks, comparisons, and regressions.

AI agent security harness, adversarial testing: 649 executable tests in the v4.28.1 release, across MCP, A2A, x402/L402, decision governance, benchmark integrity, human-in-the-loop, skill supply chain. Four target shapes: a verdict must be able to be wrong AND to be right. OWASP Agentic v1.1 T1-T17, AIUC-1 19/20 (2026-Q1/Q2 set), NIST AI 800-2.

A comprehensive evaluation framework for AI agents and LLM applications.

Open-source adversarial testing engine, SDK, and CLI for AI agents. Runs locally or against the Humanbound Platform.

Behavioral testing for AI agents.

AI Agent Evaluator & Red Team Platform

Open-source adversary emulation for AI agents and MCP servers.

Requirement-driven evaluation harness for AI agents and LLM applications. Generate behavior-specific test cases, run them against any target (hosted models, callable wrappers, OTel-traced agents), and inspect local-first artifacts.

A provider-neutral quality-engineering framework for evaluating autonomous agents by observable outcomes, side effects, authority boundaries, approval intent, adversarial conditions, verified evaluation preconditions, protocol state, authorization behavior, reliability, and reproducible evidence—not by persuasive final prose.