Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

Busbar
Busbar
It's a plan
It's a plan
Omnigraph
Omnigraph
OfinTech Desk
OfinTech Desk
Bifrost
Bifrost
Trina AX
Trina AX

openai/evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

#LLM evaluation
Visit GitHub
Python
19.8k
3.2k
461 contributors
Custom license
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Trina AX

A self-hosted team AI workspace for company files, with per-person folder permissions

Momentum

How fast openai/evals is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 23 – Nov 22, 2026

Stars +288 in 61 days

051015
13

Forks +70 in 61 days

0246
6

Merged PRs 0 in 61 days

01

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 23Oct 1Oct 9Oct 17Oct 25Nov 2Nov 10Nov 18
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Wed, Sep 23, 2026+8+10
Thu, Sep 24, 2026+4+10
Fri, Sep 25, 2026+4+00
Sat, Sep 26, 2026+2+00
Sun, Sep 27, 2026+4+00
Mon, Sep 28, 2026+4+20
Tue, Sep 29, 2026+7+10
Wed, Sep 30, 2026+3+20
Thu, Oct 1, 2026+13+20
Fri, Oct 2, 2026+6+30
Sat, Oct 3, 2026+4+00
Sun, Oct 4, 2026+3+20
Mon, Oct 5, 2026+5+20
Tue, Oct 6, 2026+2+40
Wed, Oct 7, 2026+9+40
Thu, Oct 8, 2026+8+10
Fri, Oct 9, 2026+4+10
Sat, Oct 10, 2026+5+10
Sun, Oct 11, 2026+4+00
Mon, Oct 12, 2026+2+20
Tue, Oct 13, 2026+6+10
Wed, Oct 14, 2026+6+20
Thu, Oct 15, 2026+5+10
Fri, Oct 16, 2026+4+20
Sat, Oct 17, 2026+1+30
Sun, Oct 18, 2026+3+00
Mon, Oct 19, 2026+3+00
Tue, Oct 20, 2026+1+10
Wed, Oct 21, 2026+5+00
Thu, Oct 22, 2026+8+10
Fri, Oct 23, 2026+4+10
Sat, Oct 24, 2026+7+10
Sun, Oct 25, 2026+8+10
Mon, Oct 26, 2026+5+20
Tue, Oct 27, 2026+5+10
Wed, Oct 28, 2026+6+40
Thu, Oct 29, 2026+6+30
Fri, Oct 30, 2026+6+10
Sat, Oct 31, 2026+2+20
Sun, Nov 1, 2026+3+10
Mon, Nov 2, 2026+2+00
Tue, Nov 3, 2026+8+00
Wed, Nov 4, 2026+11+00
Thu, Nov 5, 2026+3+00
Fri, Nov 6, 2026+1+00
Sat, Nov 7, 2026+3+10
Sun, Nov 8, 2026+5+10
Mon, Nov 9, 2026+2+10
Tue, Nov 10, 2026+6+00
Wed, Nov 11, 2026+5+00
Thu, Nov 12, 2026+3+10
Fri, Nov 13, 2026+5+60
Sat, Nov 14, 2026+4+00
Sun, Nov 15, 2026+2+00
Mon, Nov 16, 2026+5+00
Tue, Nov 17, 2026+12+10
Wed, Nov 18, 2026+5+00
Thu, Nov 19, 2026+0+10
Fri, Nov 20, 2026+5+00
Sat, Nov 21, 2026+3+10
Sun, Nov 22, 2026+3+00
Total+288+700
  • 1#1 on the list
  • 7Rank that day
  • Not trending
5
  • GitHub trending history

    Where the repository ranked on GitHub Trending, one dot for each day it was on a list

    Sep 28, 2023Best #25

    #1#5#10#15#20#25
    Top 10
    Oct 2023AprOctAprOct
    The left and right arrow keys step from day to day; Home and End go to the first and the last

    Mentions and achievements

    Where people are talking about openai/evals, and every badge it has earned
    1. Sep 151 post
      • Day 9 Spent it inside OpenAI's open source repos, finding real bugs by reading and running the code, not scouting the tracker, the swarm claims everything within hours. Flagship fix:…

        Read full on X, posted by @arpankernel

        @arpankernel · x.com

    2. 2 months earlier
    3. Jul 311 post
      • 6/7 The repo has barely moved since 2024, so treat it as a runner, not a living product. Useful because most of us test whether the agent still runs; almost nobody tests whether it still tells the…

        Read full on X, posted by @harleyfoote_

        @harleyfoote_ · x.com

    4. Jul 281 post
      • 6/7 Useful because most of us swap models to save money on the word of a demo, then find out three weeks later which lane it quietly broke.

        Read full on X, posted by @harleyfoote_

        @harleyfoote_ · x.com

    5. 10 days earlier
    6. Jul 181 post
      • 6/7 Useful because most agent stacks change prompts on gut feel and never find out which edit quietly made everything worse. the eval is boring. the not knowing is expensive.

        Read full on X, posted by @harleyfoote_

        @harleyfoote_ · x.com

    7. 1 month earlier
    8. Jun 41 post
      • Want to understand how modern AI actually works? Start with these foundational concepts: 1. Transformers → The Illustrated Transformer 2. LLMs → Build a Large Language Model 3. Scaling Laws →…

        Read full on X, posted by @SaurabhDub28465

        @SaurabhDub28465 · x.com

    9. Jun 31 post
      • Want to understand modern AI? Start here: 1. Transformers → Illustrated Transformer 2. LLMs → Build a Large Language Model 3. Scaling Laws → Chinchilla 4. Agents → ReAct 5. Memory → MemGPT 6. World…

        Read full on X, posted by @juleslogs

        @juleslogs · x.com

    10. 16 days earlier
    11. May 181 post
      • 4 months ago I was building AI apps the hard way Here are the GitHub repos/skills I wish I'd know about that you need to use today👇 1) google-labs-code/design.md — Persistent DESIGN.md so agents…

        Read full on X, posted by @chrisww181

        @chrisww181 · x.com

    12. May 121 post
      • 100个Claude仓库将彻底改变你的人生: (收藏这个) 1. 终端AI编码代理 2. 现成的启动应用 3. 官方代理技能 4. 插件市场 5. 完整生态系统 6. 主列表 7. 1000+插件 8. 庞大技能库 9. 精选技能 10. 跨平台技能 11. LLM管道 12. 代理工作流 13. 多代理系统 14. 团队代理 15. AI开发团队 16. 代码代理 17. 自动PR修复 18.…

        Read full on X, posted by @AIExplorerTim

        @AIExplorerTim · x.com

    You might also like

    Repositories close to openai/evals
    FeaturedAdvertise to 180K+ monthly visitors
    OfinTech Desk

    An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

    Busbar

    Control what AI can do before it acts

    It's a plan

    Open-source Linear alternative

    An issue tracker where AI agents take the work you assign them

    Trina AX

    A self-hosted team AI workspace for company files, with per-person folder permissions

    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    Omnigraph

    Versioned graph database on object storage. Git-style workflows and multimodal retrieval

    Aleph-Alpha-Research/eval-framework

    Python

    Comprehensive LLM evaluation at scale: A production-ready framework for evaluating large language models across multiple benchmarks.

    498

    OpenDCAI/One-Eval

    Python

    Automated system for LLM evaluation via agents. Doc as below:

    16529

    UKGovernmentBEIS/inspect_ai

    Python

    Inspect: A framework for large language model evaluations

    3.3k985

    cyberark/simple-llm-eval

    Python

    Simple LLM Evaluation Using LLM As a Judge 👩‍⚖️

    6813

    confident-ai/deepeval

    Python

    The LLM Evaluation Framework

    19.6k2.3k

    huggingface/lighteval

    Python

    Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

    2.6k604

    groq/openbench

    Python

    Provider-agnostic, open-source evaluation infrastructure for language models

    833109

    UpstageAI/evalverse

    Python

    The Universe of Evaluation. All about the evaluation for LLMs.

    23425

    prometheus-eval/prometheus-eval

    Python

    Evaluate your LLM's response with Prometheus and GPT4 💯

    1.1k75