Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost
Busbar
Busbar

confident-ai/deepeval

The LLM Evaluation Framework

#LLM evaluation
Visit GitHub
Python
19.4k
2.3k
279 contributors
Apache License 2.0
website
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Busbar

Control what AI can do before it acts

Momentum

How fast confident-ai/deepeval is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 10 – Nov 9, 2026

Stars +1,179 in 61 days

0204060
54

Forks +297 in 61 days

0510
10

Merged PRs 52 in 61 days

051015
11

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 10Sep 18Sep 26Oct 4Oct 12Oct 20Oct 28Nov 5
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Thu, Sep 10, 2026+16+30
Fri, Sep 11, 2026+19+60
Sat, Sep 12, 2026+13+10
Sun, Sep 13, 2026+9+21
Mon, Sep 14, 2026+20+71
Tue, Sep 15, 2026+12+50
Wed, Sep 16, 2026+17+101
Thu, Sep 17, 2026+15+50
Fri, Sep 18, 2026+17+31
Sat, Sep 19, 2026+9+60
Sun, Sep 20, 2026+17+70
Mon, Sep 21, 2026+17+30
Tue, Sep 22, 2026+25+63
Wed, Sep 23, 2026+19+72
Thu, Sep 24, 2026+16+30
Fri, Sep 25, 2026+12+60
Sat, Sep 26, 2026+8+30
Sun, Sep 27, 2026+17+70
Mon, Sep 28, 2026+19+81
Tue, Sep 29, 2026+17+30
Wed, Sep 30, 2026+17+50
Thu, Oct 1, 2026+34+20
Fri, Oct 2, 2026+28+81
Sat, Oct 3, 2026+17+30
Sun, Oct 4, 2026+27+70
Mon, Oct 5, 2026+19+42
Tue, Oct 6, 2026+15+70
Wed, Oct 7, 2026+21+22
Thu, Oct 8, 2026+26+10
Fri, Oct 9, 2026+12+60
Sat, Oct 10, 2026+12+61
Sun, Oct 11, 2026+13+50
Mon, Oct 12, 2026+26+43
Tue, Oct 13, 2026+54+100
Wed, Oct 14, 2026+38+90
Thu, Oct 15, 2026+26+66
Fri, Oct 16, 2026+18+35
Sat, Oct 17, 2026+17+70
Sun, Oct 18, 2026+14+70
Mon, Oct 19, 2026+27+71
Tue, Oct 20, 2026+26+50
Wed, Oct 21, 2026+27+60
Thu, Oct 22, 2026+23+100
Fri, Oct 23, 2026+25+73
Sat, Oct 24, 2026+15+60
Sun, Oct 25, 2026+16+10
Mon, Oct 26, 2026+21+30
Tue, Oct 27, 2026+25+40
Wed, Oct 28, 2026+24+60
Thu, Oct 29, 2026+17+61
Fri, Oct 30, 2026+17+60
Sat, Oct 31, 2026+11+10
Sun, Nov 1, 2026+17+30
Mon, Nov 2, 2026+24+311
Tue, Nov 3, 2026+18+10
Wed, Nov 4, 2026+21+61
Thu, Nov 5, 2026+25+74
Fri, Nov 6, 2026+21+50
Sat, Nov 7, 2026+17+11
Sun, Nov 8, 2026+13+00
Mon, Nov 9, 2026+1+00
Total+1,179+29752
  • 1#1 on the list
  • 7Rank that day
  • Not trending
1

    • GitHub trending history

    Where the repository ranked on GitHub Trending, one dot for each day it was on a list

    Jun 12 – Sep 25, 2025Best #3

    #1#5#10#15#20#25
    Top 10
    Jan 2024JulJan 2025JulJan 2026
    The left and right arrow keys step from day to day; Home and End go to the first and the last

    Mentions and achievements

    Where people are talking about confident-ai/deepeval, and every badge it has earned
    1. Nov 81 post

      • 01｜Promptfoo 把同一批測試題交給不同提示詞與模型，並排比較結果，也能接進 CI。適合改提示詞前後做回歸測試，少靠感覺選版本。

        Read full on X, posted by @2015ayien

        @2015ayien · x.com

    2. 9 days earlier
    3. Oct 301 post

      • 别再把 Demo 当产品上线——这 6 个开源项目，把编排、网关、私有面、评测装上： 1 → Dify（约 16 万星） 可视化搭 AI 应用 / 工作流，产品同学也能改流程 2 → n8n（约 20.9 万星） 模型接到真实触发器：表单 / Webhook / 定时任务

        Read full on X, posted by @perry_weijie

        @perry_weijie · x.com

    4. Oct 281 post

      • 5 个能让 AI 检查自己工作的 GitHub 仓库： 1. Self-Refine 2. Reflexion 3. DeepEval 4. Promptfoo 5. Inspect AI

        Read full on X, posted by @0xluffy_eth

        @0xluffy_eth · x.com

    5. Oct 271 post

      • 这五个让AI检查自己错误的项目，你绝对用得上！ 他们分别解决改稿、失败重试和系统评测的问题。 1｜Self-Refine：让 AI 对自己的初稿提意见 先生成内容，再让模型指出具体问题，然后按反馈修改，可以反复迭代。 适合文案润色、代码改进等任务。 GitHub： 2｜Reflexion：让 Agent 吸取上一次失败的经验…

        Read full on X, posted by @CY160909

        @CY160909 · x.com

    6. Oct 251 post

      • OpenAI 把 Promptfoo 收进门了，GitHub 简介还写着 Anthropic 也在用。Agent 不测就上线，出事才贵。下面 5 个仓够起步。 1. Promptfoo 声明式评测加红队扫描，CLI 能接进 CI。 2. Inspect 英国 AI 安全研究所开源的大模型评测框架，自带 200 多套现成评测。 3. DeepEval 像 Pytest 一样给 LLM…

        Read full on X, posted by @firelight279

        @firelight279 · x.com

    7. Oct 221 post

      • RAG 回答看起来对，怎么系统评测？📏 DeepEval 给 LLM 应用写自动化评测，检查回答质量和检索效果。改 Prompt 前后有据可比。🧪 #LLMOps #浇朋友 #蓝朋友 #互关 #fo

        Read full on X, posted by @T1doo_AI

        @T1doo_AI · x.com

    8. 8 days earlier
    9. Oct 142 posts

      • 8 open-source GitHub repos every AI agent developer should know. from catching hallucinations to debugging tool calls and tracking costs. these are genuinely useful for building agents that actually…

        Read full on X, posted by @arjunkshah21

        @arjunkshah21 · x.com

      • 如果你想做一个真正能用的 AI 数据分析助手，这 6 个开源项目刚好能拼出一条完整流程： 用户提问 → 生成 SQL → 安全检查 → 执行查询 → 整理数据 → 验证答案 → 记录问题 Vanna 让用户直接用自然语言提问，再根据你的数据库结构生成 SQL。 DuckDB 直接在程序内部运行分析型 SQL，处理本地文件和数据集很方便。 SQLGlot 解析、检查和改写…

        Read full on X, posted by @bdall_1

        @bdall_1 · x.com

    10. 8 days earlier
    11. Oct 61 post

      • 搭建GPT-6 Astra配套系统的10个开源GitHub项目： 构建智能体 01｜ PydanticAI ▸ [ 类型安全智能体，支持结构化输出 02｜ LangGraph ▸ [ 状态管理，构建长周期运行的Agent工作流 03 ｜Agno ▸ [ 智能体集群、多角色协作与任务编排 04｜ smolagents ▸ [ 可执行代码的代码驱动型智能体 赋予记忆 05｜ Mem0 ▸ […

        Read full on X, posted by @MirrortekUK

        @MirrortekUK · x.com

    12. Oct 41 post

      • GitHub 上 AI 智能体的发展已经离谱了。 10 个开源仓库，能把一个强模型变成完整的自主系统。 1. LangGraph 有状态的智能体编排。 2. PydanticAI 带类型的智能体 + 结构化输出。 搭建控制层 3. Mastra 智能体、工作流和记忆。 4. Agno 多智能体系统。 给它上下文 5. Cognee 把数据变成知识和智能体记忆。 6. Graphiti…

        Read full on X, posted by @crypto_oldk

        @crypto_oldk · x.com

    You might also like

    Repositories close to confident-ai/deepeval
    FeaturedAdvertise to 180K+ monthly visitors
    Busbar

    Control what AI can do before it acts

    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    openai/evals

    Python

    Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

    19.7k3.2k

    UKGovernmentBEIS/inspect_ai

    Python

    Inspect: A framework for large language model evaluations

    3.2k924

    vibrantlabsai/ragas

    Python

    Supercharge Your LLM Application Evaluations 🚀

    16.3k2k

    relari-ai/continuous-eval

    Python

    Data-Driven Evaluation for LLM-Powered Applications

    51939

    OpenDCAI/One-Eval

    Python

    Automated system for LLM evaluation via agents. Doc as below:

    16529

    Aleph-Alpha-Research/eval-framework

    Python

    Comprehensive LLM evaluation at scale: A production-ready framework for evaluating large language models across multiple benchmarks.

    477

    safety-research/bloom

    Python

    bloom - evaluate any behavior immediately  🌸🌱

    1.4k177

    langchain-ai/openevals

    Python

    Readymade evaluators for your LLM apps

    1.2k146

    cyberark/simple-llm-eval

    Python

    Simple LLM Evaluation Using LLM As a Judge 👩‍⚖️

    6812