Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost
Busbar
Busbar
ClawBench
ClawBench

ianarawjo/evalstats

Statistical inference for AI evaluations, from model comparisons to corrections for LLM judge bias, optimized for small sample sizes. All defaults battle-tested in Monte Carlo simulations.

Visit GitHub
Python
130
3
1 contributors
Custom license
website
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

Busbar

Control what AI can do before it acts

ClawBench

a benchmark for personal agents

Momentum

How fast ianarawjo/evalstats is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Aug 26 – Oct 23, 2026

Stars +16 in 59 days

0246
5

Forks +1 in 59 days

01
1

Merged PRs 5 in 59 days

01
1

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Aug 26Sep 3Sep 11Sep 19Sep 27Oct 5Oct 13Oct 21
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Wed, Aug 26, 2026+1+00
Thu, Aug 27, 2026+0+00
Fri, Aug 28, 2026+1+01
Sat, Aug 29, 2026+5+00
Sun, Aug 30, 2026+3+00
Mon, Aug 31, 2026+0+00
Tue, Sep 1, 2026+0+00
Wed, Sep 2, 2026+0+00
Thu, Sep 3, 2026+1+00
Fri, Sep 4, 2026+0+00
Sat, Sep 5, 2026+0+00
Sun, Sep 6, 2026+0+00
Mon, Sep 7, 2026+0+00
Tue, Sep 8, 2026+0+00
Wed, Sep 9, 2026+0+00
Thu, Sep 10, 2026+0+00
Fri, Sep 11, 2026+0+00
Sat, Sep 12, 2026+0+01
Sun, Sep 13, 2026+0+00
Mon, Sep 14, 2026+0+01
Tue, Sep 15, 2026+0+01
Wed, Sep 16, 2026+0+00
Thu, Sep 17, 2026+0+00
Fri, Sep 18, 2026+0+00
Sat, Sep 19, 2026+0+00
Sun, Sep 20, 2026+0+01
Mon, Sep 21, 2026+0+00
Tue, Sep 22, 2026+1+00
Wed, Sep 23, 2026+0+00
Thu, Sep 24, 2026+0+00
Fri, Sep 25, 2026+0+00
Sat, Sep 26, 2026+0+00
Sun, Sep 27, 2026+0+00
Mon, Sep 28, 2026+0+00
Tue, Sep 29, 2026+0+00
Wed, Sep 30, 2026+1+10
Thu, Oct 1, 2026+0+00
Fri, Oct 2, 2026+1+00
Sat, Oct 3, 2026+0+00
Sun, Oct 4, 2026+0+00
Mon, Oct 5, 2026+0+00
Tue, Oct 6, 2026+0+00
Wed, Oct 7, 2026+0+00
Thu, Oct 8, 2026+0+00
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+1+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+1+00
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+0+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+0+00
Mon, Oct 19, 2026+0+00
Tue, Oct 20, 2026+0+00
Wed, Oct 21, 2026+0+00
Thu, Oct 22, 2026+0+00
Fri, Oct 23, 2026+0+00
Total+16+15
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Jun 201 post

    • Running stats over LLM judges and calling it 'significant'? STOP! Get human experts to grade a subset of data, THEN use evalstats to get *corrected* p-values for t-test, MWU, Wilcoxon, and ANOVA…

      Read full on X, posted by @IanArawjo

      @IanArawjo · x.com

You might also like

Repositories close to ianarawjo/evalstats
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

ClawBench

a benchmark for personal agents

Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

EmertonData/glide

Python

Helping humans ride the GenAI evaluation wave

1193

UKGovernmentBEIS/inspect_evals

Python

Collection of evals for Inspect AI

712454

braintrustdata/autoevals

Python

AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.

1.1k95

dustalov/evalica

Python

Evalica, your favourite evaluation toolkit

685

OpenDCAI/One-Eval

Python

Automated system for LLM evaluation via agents. Doc as below:

16329

evaleval/every_eval_ever

Python

Every Eval Ever is a shared schema and crowdsourced eval database. It defines a standardized metadata format for storing AI evaluation results — from leaderboard scrapes and research papers to local evaluation runs — so that results from different frameworks can be compared, reproduced, and reused.

13752

huggingface/evaluate

Python

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

2.5k360

IBM/unitxt

Python

🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data for end-to-end AI benchmarking

21570

cyberark/simple-llm-eval

Python

Simple LLM Evaluation Using LLM As a Judge 👩‍⚖️

6812