Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

Busbar
Busbar
It's a plan
It's a plan
OfinTech Desk
OfinTech Desk
Omnigraph
Omnigraph
Bifrost
Bifrost

Aleph-Alpha-Research/eval-framework

Comprehensive LLM evaluation at scale: A production-ready framework for evaluating large language models across multiple benchmarks.

#LLM evaluation
Visit GitHub
Python
48
8
34 contributors
Apache License 2.0
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast Aleph-Alpha-Research/eval-framework is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 21 – Nov 20, 2026

Stars +5 in 61 days

01
1

Forks +2 in 61 days

01
1

Merged PRs 407 in 61 days

051015
13

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 21Sep 29Oct 7Oct 15Oct 23Oct 31Nov 8Nov 16
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Mon, Sep 21, 2026+0+07
Tue, Sep 22, 2026+0+09
Wed, Sep 23, 2026+0+03
Thu, Sep 24, 2026+0+03
Fri, Sep 25, 2026+0+08
Sat, Sep 26, 2026+0+08
Sun, Sep 27, 2026+0+06
Mon, Sep 28, 2026+0+09
Tue, Sep 29, 2026+0+08
Wed, Sep 30, 2026+0+03
Thu, Oct 1, 2026+0+05
Fri, Oct 2, 2026+0+08
Sat, Oct 3, 2026+1+09
Sun, Oct 4, 2026+0+05
Mon, Oct 5, 2026+0+010
Tue, Oct 6, 2026+0+07
Wed, Oct 7, 2026+0+07
Thu, Oct 8, 2026+0+04
Fri, Oct 9, 2026+1+02
Sat, Oct 10, 2026+0+05
Sun, Oct 11, 2026+0+05
Mon, Oct 12, 2026+0+08
Tue, Oct 13, 2026+0+011
Wed, Oct 14, 2026+0+09
Thu, Oct 15, 2026+0+011
Fri, Oct 16, 2026+0+05
Sat, Oct 17, 2026+0+03
Sun, Oct 18, 2026+0+07
Mon, Oct 19, 2026+0+07
Tue, Oct 20, 2026+0+013
Wed, Oct 21, 2026+0+06
Thu, Oct 22, 2026+0+03
Fri, Oct 23, 2026+0+08
Sat, Oct 24, 2026+0+04
Sun, Oct 25, 2026+0+09
Mon, Oct 26, 2026+1+09
Tue, Oct 27, 2026+0+09
Wed, Oct 28, 2026+0+03
Thu, Oct 29, 2026+0+14
Fri, Oct 30, 2026+0+07
Sat, Oct 31, 2026+0+07
Sun, Nov 1, 2026+0+010
Mon, Nov 2, 2026+0+02
Tue, Nov 3, 2026+0+010
Wed, Nov 4, 2026+0+03
Thu, Nov 5, 2026+1+09
Fri, Nov 6, 2026+0+07
Sat, Nov 7, 2026+0+07
Sun, Nov 8, 2026+0+04
Mon, Nov 9, 2026+0+010
Tue, Nov 10, 2026+0+010
Wed, Nov 11, 2026+0+14
Thu, Nov 12, 2026+0+06
Fri, Nov 13, 2026+0+06
Sat, Nov 14, 2026+0+05
Sun, Nov 15, 2026+0+02
Mon, Nov 16, 2026+0+010
Tue, Nov 17, 2026+0+010
Wed, Nov 18, 2026+0+06
Thu, Nov 19, 2026+1+07
Fri, Nov 20, 2026+0+05
Total+5+2407
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Oct 31 post
    • Aleph Alpha has always worked on evaluations. Earlier this year we set up the current model evals team to support scaled-up training and development. I was excited to help contribute to its early…

      Read full on X, posted by @tfburns

      @tfburns · x.com

You might also like

Repositories close to Aleph-Alpha-Research/eval-framework
FeaturedAdvertise to 180K+ monthly visitors
OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

Busbar

Control what AI can do before it acts

openai/evals

Python

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

19.8k3.2k

huggingface/lighteval

Python

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

2.6k601

cyberark/simple-llm-eval

Python

Simple LLM Evaluation Using LLM As a Judge 👩‍⚖️

6813

groq/openbench

Python

Provider-agnostic, open-source evaluation infrastructure for language models

833109

open-compass/opencompass

Python

OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

7.6k938

OpenDCAI/One-Eval

Python

Automated system for LLM evaluation via agents. Doc as below:

16529

UKGovernmentBEIS/inspect_ai

Python

Inspect: A framework for large language model evaluations

3.3k976

mlfoundations/evalchemy

HTML

Automatic evals for LLMs

61781

UpstageAI/evalverse

Python

The Universe of Evaluation. All about the evaluation for LLMs.

23425