UKGovernmentBEIS/inspect_ai

Inspect: A framework for large language model evaluations

#LLM evaluation

Python

3.2k

924

247 contributors

MIT License

FeaturedAdvertise to 180K+ monthly visitors

Control what AI can do before it acts

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast UKGovernmentBEIS/inspect_ai is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 10 – Nov 9, 2026

Stars +467 in 61 days

17

Forks +208 in 61 days

10

Merged PRs 562 in 61 days

29

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 10Sep 18Sep 26Oct 4Oct 12Oct 20Oct 28Nov 5

Stars, forks, merged pull requests and Trendshift Trending rank, by day
Day	Stars gained	Forks gained	Merged PRs
Thu, Sep 10, 2026	+10	+2	7
Fri, Sep 11, 2026	+5	+6	8
Sat, Sep 12, 2026	+5	+2	0
Sun, Sep 13, 2026	+6	+1	7
Mon, Sep 14, 2026	+8	+0	10
Tue, Sep 15, 2026	+7	+9	6
Wed, Sep 16, 2026	+6	+6	14
Thu, Sep 17, 2026	+16	+3	5
Fri, Sep 18, 2026	+8	+3	1
Sat, Sep 19, 2026	+1	+1	1
Sun, Sep 20, 2026	+8	+3	0
Mon, Sep 21, 2026	+11	+2	13
Tue, Sep 22, 2026	+14	+2	19
Wed, Sep 23, 2026	+9	+3	12
Thu, Sep 24, 2026	+3	+2	6
Fri, Sep 25, 2026	+5	+3	9
Sat, Sep 26, 2026	+3	+2	5
Sun, Sep 27, 2026	+4	+1	0
Mon, Sep 28, 2026	+10	+1	5
Tue, Sep 29, 2026	+9	+3	16
Wed, Sep 30, 2026	+17	+1	7
Thu, Oct 1, 2026	+7	+3	2
Fri, Oct 2, 2026	+13	+3	3
Sat, Oct 3, 2026	+8	+4	5
Sun, Oct 4, 2026	+2	+2	10
Mon, Oct 5, 2026	+10	+4	21
Tue, Oct 6, 2026	+4	+2	19
Wed, Oct 7, 2026	+7	+8	3
Thu, Oct 8, 2026	+9	+3	25
Fri, Oct 9, 2026	+3	+3	5
Sat, Oct 10, 2026	+9	+3	3
Sun, Oct 11, 2026	+10	+3	0
Mon, Oct 12, 2026	+6	+4	6
Tue, Oct 13, 2026	+5	+3	13
Wed, Oct 14, 2026	+10	+2	17
Thu, Oct 15, 2026	+8	+4	10
Fri, Oct 16, 2026	+7	+4	12
Sat, Oct 17, 2026	+8	+8	0
Sun, Oct 18, 2026	+11	+3	0
Mon, Oct 19, 2026	+5	+2	6
Tue, Oct 20, 2026	+10	+6	14
Wed, Oct 21, 2026	+4	+5	12
Thu, Oct 22, 2026	+5	+10	4
Fri, Oct 23, 2026	+12	+5	29
Sat, Oct 24, 2026	+6	+3	4
Sun, Oct 25, 2026	+13	+2	6
Mon, Oct 26, 2026	+10	+2	18
Tue, Oct 27, 2026	+11	+5	21
Wed, Oct 28, 2026	+9	+5	16
Thu, Oct 29, 2026	+6	+8	13
Fri, Oct 30, 2026	+13	+3	8
Sat, Oct 31, 2026	+5	+2	3
Sun, Nov 1, 2026	+2	+1	2
Mon, Nov 2, 2026	+7	+4	27
Tue, Nov 3, 2026	+7	+6	16
Wed, Nov 4, 2026	+10	+5	25
Thu, Nov 5, 2026	+13	+2	9
Fri, Nov 6, 2026	+4	+4	9
Sat, Nov 7, 2026	+10	+5	9
Sun, Nov 8, 2026	+3	+1	6
Mon, Nov 9, 2026	+0	+0	0
Total	+467	+208	562

#1 on the list
Rank that day
Not trending

Mentions and achievements

Where people are talking about UKGovernmentBEIS/inspect_ai, and every badge it has earned

Oct 311 post
- your agent says "done". the trace is the only place that shows what it actually did. open-source tools to see inside agent runs, then score them: - langfuse: traces, evals, prompt versions - phoenix:…
  Read full on X, posted by @MohakBajaj5
  @MohakBajaj5 · x.com
Oct 281 post
- 5 个能让 AI 检查自己工作的 GitHub 仓库： 1. Self-Refine 2. Reflexion 3. DeepEval 4. Promptfoo 5. Inspect AI
  Read full on X, posted by @0xluffy_eth
  @0xluffy_eth · x.com
Oct 271 post
- 这五个让AI检查自己错误的项目，你绝对用得上！他们分别解决改稿、失败重试和系统评测的问题。 1｜Self-Refine：让 AI 对自己的初稿提意见先生成内容，再让模型指出具体问题，然后按反馈修改，可以反复迭代。适合文案润色、代码改进等任务。 GitHub： 2｜Reflexion：让 Agent 吸取上一次失败的经验…
  Read full on X, posted by @CY160909
  @CY160909 · x.com
Oct 251 post
- OpenAI 把 Promptfoo 收进门了，GitHub 简介还写着 Anthropic 也在用。Agent 不测就上线，出事才贵。下面 5 个仓够起步。 1. Promptfoo 声明式评测加红队扫描，CLI 能接进 CI。 2. Inspect 英国 AI 安全研究所开源的大模型评测框架，自带 200 多套现成评测。 3. DeepEval 像 Pytest 一样给 LLM…
  Read full on X, posted by @firelight279
  @firelight279 · x.com
11 days earlier
Oct 141 post
- 8 open-source GitHub repos every AI agent developer should know. from catching hallucinations to debugging tool calls and tracking costs. these are genuinely useful for building agents that actually…
  Read full on X, posted by @arjunkshah21
  @arjunkshah21 · x.com
13 days earlier
Oct 11 post
- Open an evaluation score and read the model interaction behind it. Inspect AI is an LLM evaluation framework from the UK AI Security Institute. It supports tool use, multi-turn tasks and scoring,…
  Read full on X, posted by @ChatchanX
  @ChatchanX · x.com
Sep 301 post
- 11/ There is a contributing guide for anyone who wants to improve it using NVIDIA's Python SDK instead of the current OpenShell CLI interface. Provider: Code and transcripts: (tag openshell-sandbox)
  Read full on X, posted by @32bitsret
  @32bitsret · x.com
8 days earlier
Sep 222 posts
- 5/6 The key distinction is model performance vs. measurement coverage. A score can be accurate for the samples that were scored while still hiding how much of the evaluation produced no score. The…
  Read full on X, posted by @mattinfra
  @mattinfra · x.com
- 5/6 I posted the comparison back to the issue with concrete regression cases. It separated two bugs that looked similar: 1. matching “yes/no” inside other words 2. extracting the answer from the…
  Read full on X, posted by @mattinfra
  @mattinfra · x.com
3 months earlier
Jul 21 post
- Local benchmarks with a RTX 3090 - Qwen3.6 27b vs Ornith
  Read full on Reddit
  r/LocalLLaMA