google-deepmind/uncertain_ground_truth

High-quality implementations of standard and SOTA methods on a variety of tasks.

relplot: Utilities for measuring calibration and plotting reliability diagrams

A professionally curated list of awesome Conformal Prediction videos, tutorials, books, papers, PhD and MSc theses, articles and open-source libraries.

An AI research analyst that knows when to trust itself — a calibrated, risk-controlled, tool-using agent for science.

A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.

👋 Puncc is a python library for predictive uncertainty quantification using conformal prediction.

[ICML 2025] MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understanding

Collection of evals for Inspect AI

Agent benchmark for medical diagnosis