Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

Busbar
Busbar
Websitebench
Websitebench
Omnigraph
Omnigraph
Bifrost
Bifrost

probkit/CalArena

CalArena is a large-scale benchmark for post-hoc calibration of classification models.

Visit GitHub
Python
20
3
1 contributors
Apache License 2.0
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

Websitebench

Can AI agents reverse-engineer real websites?

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast probkit/CalArena is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Oct 10 – Nov 14, 2026

Stars +2 in 36 days

01
1

Forks +1 in 36 days

01
1

Merged PRs 0 in 36 days

01

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Oct 10Oct 15Oct 20Oct 25Oct 30Nov 4Nov 9Nov 14
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sat, Oct 10, 2026+1+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+0+00
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+0+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+0+00
Mon, Oct 19, 2026+0+00
Tue, Oct 20, 2026+0+00
Wed, Oct 21, 2026+0+00
Thu, Oct 22, 2026+0+00
Fri, Oct 23, 2026+0+00
Sat, Oct 24, 2026+0+00
Sun, Oct 25, 2026+1+00
Mon, Oct 26, 2026+0+00
Tue, Oct 27, 2026+0+00
Wed, Oct 28, 2026+0+00
Thu, Oct 29, 2026+0+00
Fri, Oct 30, 2026+0+00
Sat, Oct 31, 2026+0+10
Sun, Nov 1, 2026+0+00
Mon, Nov 2, 2026+0+00
Tue, Nov 3, 2026+0+00
Wed, Nov 4, 2026+0+00
Thu, Nov 5, 2026+0+00
Fri, Nov 6, 2026+0+00
Sat, Nov 7, 2026+0+00
Sun, Nov 8, 2026+0+00
Mon, Nov 9, 2026+0+00
Tue, Nov 10, 2026+0+00
Wed, Nov 11, 2026+0+00
Thu, Nov 12, 2026+0+00
Fri, Nov 13, 2026+0+00
Sat, Nov 14, 2026+0+00
Total+2+10
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. May 295 posts6 posts
    • Code: Our work is based on the open-source calibration package probmetrics, which we have been developing publicly for a year and a half ( The entire CalArena codebase is also openly accessible (

      Read full on X, posted by @Eugene_Berta

      @Eugene_Berta · x.com

    • You seem to report relative differences for various metrics. We open-sourced all our code base and data, a quick look there would show you that our work is 100% original.

      Read full on X, posted by @Eugene_Berta

      @Eugene_Berta · x.com

    • Code: Our work is based on the open-source calibration package probmetrics, which we have been developing publicly for a year and a half ( The entire CalArena codebase is also openly accessible (

      Read full on X, posted by @Eugene_Berta

      @Eugene_Berta · x.com

    • You seem to report relative differences for various metrics. We open-sourced all our code base and data, a quick look there would show you that our work is original.

      Read full on X, posted by @Eugene_Berta

      @Eugene_Berta · x.com

    • Hi, Accusing researchers of plagiarism publicly is a serious allegation and not something that should be made lightly, especially when you have not contacted us beforehand. Most importantly, there is…

      Read full on X, posted by @Eugene_Berta

      @Eugene_Berta · x.com

    • CalArena evaluates 19 binary and 18 multiclass calibration methods across roughly 2000 classification experiments. One core insight: Parametric logistic models consistently outperform the…

      Read full on X, posted by @Eugene_Berta

      @Eugene_Berta · x.com

You might also like

Repositories close to probkit/CalArena
FeaturedAdvertise to 180K+ monthly visitors
Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Busbar

Control what AI can do before it acts

Websitebench

Can AI agents reverse-engineer real websites?

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

probkit/probmetrics

Python

Post-hoc calibration methods and metrics for classification

758

facebookincubator/MCGrad

Jupyter Notebook

MCGrad is a scalable and easy-to-use tool for multicalibration. It ensures your ML model predictions are well-calibrated not just globally (across all data), but also across virtually any segment defined by your features

528

apple-aiml-research/ml-calibration

Jupyter Notebook

relplot: Utilities for measuring calibration and plotting reliability diagrams

19112

ip200/venn-abers

Python

Python implementation of binary and multi-class Venn-ABERS calibration

20817

activatedgeek/calibration-tuning

Jupyter Notebook
537

ptocca/VennABERS

Python

Fast implementation of Venn-ABERS probabilistic predictors

7914

google-research/robustness_metrics

Jupyter Notebook
47532

google-deepmind/uncertain_ground_truth

Python

Dermatology ddx dataset, Jax implementations of Monte Carlo conformal prediction, plausibility regions and statistical annotation aggregation from our recent work on uncertain ground truth (TMLR'23 and ArXiv pre-print).

68148

tidymodels/probably

R

Tools for post-processing class probability estimates

12316