Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost

promptfoo/promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

#LLM evaluation
Visit GitHub
TypeScript
26.8k
2.8k
322 contributors
MIT License
website
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast promptfoo/promptfoo is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 6 – Nov 5, 2026

Stars +2,004 in 61 days

050100
62

Forks +422 in 61 days

0102030
22

Merged PRs 985 in 61 days

050100
98

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 6Sep 14Sep 22Sep 30Oct 8Oct 16Oct 24Nov 1
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sun, Sep 6, 2026+20+52
Mon, Sep 7, 2026+40+515
Tue, Sep 8, 2026+30+698
Wed, Sep 9, 2026+41+925
Thu, Sep 10, 2026+30+414
Fri, Sep 11, 2026+28+59
Sat, Sep 12, 2026+14+012
Sun, Sep 13, 2026+17+24
Mon, Sep 14, 2026+35+814
Tue, Sep 15, 2026+45+1014
Wed, Sep 16, 2026+41+1330
Thu, Sep 17, 2026+49+59
Fri, Sep 18, 2026+34+74
Sat, Sep 19, 2026+22+47
Sun, Sep 20, 2026+21+66
Mon, Sep 21, 2026+28+414
Tue, Sep 22, 2026+34+314
Wed, Sep 23, 2026+28+137
Thu, Sep 24, 2026+21+37
Fri, Sep 25, 2026+37+59
Sat, Sep 26, 2026+17+514
Sun, Sep 27, 2026+23+554
Mon, Sep 28, 2026+37+831
Tue, Sep 29, 2026+25+1326
Wed, Sep 30, 2026+38+1128
Thu, Oct 1, 2026+29+629
Fri, Oct 2, 2026+24+48
Sat, Oct 3, 2026+25+612
Sun, Oct 4, 2026+26+62
Mon, Oct 5, 2026+24+439
Tue, Oct 6, 2026+34+610
Wed, Oct 7, 2026+32+67
Thu, Oct 8, 2026+25+542
Fri, Oct 9, 2026+27+491
Sat, Oct 10, 2026+31+451
Sun, Oct 11, 2026+24+751
Mon, Oct 12, 2026+42+1011
Tue, Oct 13, 2026+34+419
Wed, Oct 14, 2026+22+96
Thu, Oct 15, 2026+20+510
Fri, Oct 16, 2026+50+116
Sat, Oct 17, 2026+19+51
Sun, Oct 18, 2026+24+120
Mon, Oct 19, 2026+41+516
Tue, Oct 20, 2026+47+91
Wed, Oct 21, 2026+44+512
Thu, Oct 22, 2026+62+225
Fri, Oct 23, 2026+45+145
Sat, Oct 24, 2026+34+60
Sun, Oct 25, 2026+36+815
Mon, Oct 26, 2026+49+104
Tue, Oct 27, 2026+43+80
Wed, Oct 28, 2026+49+104
Thu, Oct 29, 2026+39+72
Fri, Oct 30, 2026+50+1115
Sat, Oct 31, 2026+24+12
Sun, Nov 1, 2026+27+616
Mon, Nov 2, 2026+55+616
Tue, Nov 3, 2026+42+103
Wed, Nov 4, 2026+39+96
Thu, Nov 5, 2026+11+21
Total+2,004+422985
  • 1#1 on the list
  • 7Rank that day
  • Not trending
1

    • GitHub trending history

    Where the repository ranked on GitHub Trending, one dot for each day it was on a list

    May 31, 2025 – Mar 13, 2026Best #3

    #1#5#10#15#20#25
    Top 10
    Oct 2023AprOctAprOctAprOct
    The left and right arrow keys step from day to day; Home and End go to the first and the last

    Mentions and achievements

    Where people are talking about promptfoo/promptfoo, and every badge it has earned
    1. Nov 42 posts

      • CrowdStrike is paying $495M, per the WSJ, for two startups that keep AI agents in line. Dreadnode attacks your agent before launch. Fiddler records what it did after. Agent security is now a budget…

        Read full on X, posted by @FarisBrni

        @FarisBrni · x.com

      • The whole flow in one picture. The same commands run in CI (GitHub Actions, GitLab CI, Jenkins), so a prompt change that breaks a test can fail the build. Do you run LLM evals in CI yet? Yes or no?

        Read full on X, posted by @akashsairaja

        @akashsairaja · x.com

    2. Nov 31 post

      • 很多 Agent demo 的问题不是不会回答，而是没人知道它为什么这次答对、下次答错，也不知道一次改 prompt 到底改变了什么。下面五个项目分别覆盖评测、追踪、可观测性和 OpenTelemetry 接入，适合把实验带进工程流程。

        Read full on X, posted by @taozi0603

        @taozi0603 · x.com

    3. Nov 12 posts5 posts

      • Nothing hidden. Every model on Outrun is audited every 3 days with open-source tools, and every result is published, including the misses.

        Read full on X, posted by @outrunai

        @outrunai · x.com

      • Notable Open-Source Projects this week: - LMCache: Implements KV-cache reuse, adaptive eviction and HTTP API-key authentication. Relevant for reducing inference latency in repeated-context workloads.…

        Read full on X, posted by @KTee95d

        @KTee95d · x.com

      • 25 个可本机跑的开源 AI 项目清单合集 NotebookLM 好用，但资料不想上传云端；本地又总缺一整套「能装就跑」的开源清单。 我存了这条 25 个开源 AI 项目合集，本机就能跑： 1. Open Notebook — 开源自托管 NotebookLM 平替 — 2. Podcastfy — 把文章/PDF/视频变成 AI 播客对话 — 3. Screenshot to Code —…

        Read full on X, posted by @bitmeowAI

        @bitmeowAI · x.com

      • Top 10 Open Agent Security & Sandbox Tools: 1. Security Audit Skill - 2. Promptfoo - 3. SkillSpector - 4. OpenShell - 5. E2B - 6. garak - 7. microsandbox - 8. NeMo Guardrails - 9. Sandbox Runtime -…

        Read full on X, posted by @AsWill11

        @AsWill11 · x.com

      • 25 open-source AI projects on GitHub that feel illegal to know All open-source. Most are free to run on your own machine. 1. Open Notebook An open-source, self-hosted alternative to NotebookLM. 2.…

        Read full on X, posted by @hey_SpencerAI

        @hey_SpencerAI · x.com

    4. Oct 311 post

      • your agent says "done". the trace is the only place that shows what it actually did. open-source tools to see inside agent runs, then score them: - langfuse: traces, evals, prompt versions - phoenix:…

        Read full on X, posted by @MohakBajaj5

        @MohakBajaj5 · x.com

    5. Oct 301 post

      • 改完代码不敢发，靠人肉点一遍又点不全。 按能不能真把用例写出来挑的，接口、网页、Python 侧、AI 应用四种场景各占一格。 1. keploy/keploy 录下线上真实请求，自动生成用例和 mock，接口到端到端都不用手写。18923 星。别人教你怎么把测试补上，它让流量自己长出用例： 2. microsoft/playwright 一个 API 压住…

        Read full on X, posted by @joganicpe

        @joganicpe · x.com

    You might also like

    Repositories close to promptfoo/promptfoo
    FeaturedAdvertise to 180K+ monthly visitors
    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    promptfoo/promptfoo-action

    TypeScript

    The GitHub Action for Promptfoo. Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

    8036

    airtasystems/Genbounty-LLM-Hunter-Community-Free

    Python

    Toolkit for AI whitehats, internal red teams, llm bug bounty hunters and mlops - Adversarial testing for AI, LLMs, and Agents.

    287

    confident-ai/deepeval

    Python

    The LLM Evaluation Framework

    19.3k2.2k

    Giskard-AI/giskard-oss

    Python

    🐢 Open-Source Evaluation & Testing library for LLM Agents

    5.9k578

    votal-ai-hq/ai-red-teaming

    Python

    Whitebox & Blackbox AI red-teaming framework for LLMs & Agentic AI apps. It analyzes your app's source code to discover tools, roles, and guardrails, then generates new attacks chains across several categories and adapts over multiple multi turn rounds to find vulnerabilities

    4016

    UKGovernmentBEIS/inspect_ai

    Python

    Inspect: A framework for large language model evaluations

    3.2k907

    msoedov/agentic_security

    Python

    Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

    2k312

    langchain-ai/openevals

    Python

    Readymade evaluators for your LLM apps

    1.2k144

    NiceEval/NiceEval

    TypeScript

    build eval for your agent in 10 mins

    1637