Signal
Advertise
Signal
Advertise
Sign in
Submit
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
Log in
rbrus/agent-redteam-benchmark — GitHub trending stats & insights | Trendshift
Busbar
Kane CLI
Bifrost
rbrus/agent-redteam-benchmark
#
AI agent
Gateway, oracles and unified scoring for a head-to-head benchmark of AI red-teaming tools
Visit GitHub
Like rbrus/agent-redteam-benchmark, 0 likes
0
Bookmark rbrus/agent-redteam-benchmark, 0 bookmarks
0
Python
1
1 contributors
Social mentions
Recent discussions about this repository across the web
The fix in v0.4.0 was a shared "rule-recitation" marker that applies to every technique. I measured it offline against replies that were already recorded and scored, then re-ran it live. Recall went…
@sixi4ai · x.com
What it isn't: the broadest tool. promptfoo landed 89 distinct attacks and garak 67. sixi landed 7. Breadth is the gap, and I've put it in the chart rather than hide it.
@sixi4ai · x.com
Confirmed violations, from the wire: promptfoo 89 garak 81 DeepTeam 22 sixi-scanner 22 (with best recall) PyRIT 16 Azure AI Red Teaming Agent 3 (64% of its turns blocked by Azure's own filters)…
@sixi4ai · x.com
Full disclosure: I maintain one of the tools under test (sixi-scanner). It is improving with every update, yet it is stable and consistent with less runs.
@sixi4ai · x.com
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues