Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Websitebench
Websitebench
Busbar
Busbar
Omnigraph
Omnigraph
Bifrost
Bifrost

aisa-group/decomposing-eval-awareness

Decomposing and measuring evaluation awareness in existing benchmarks and our proposed EvalAwareBench.

#LLM evaluation
Visit GitHub
Python
20
4
1 contributors
Custom license
website
FeaturedAdvertise to 180K+ monthly visitors
Websitebench

Can AI agents reverse-engineer real websites?

Busbar

Control what AI can do before it acts

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast aisa-group/decomposing-eval-awareness is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 15 – Nov 14, 2026

Stars +2 in 61 days

01
1

Forks +0 in 61 days

01

Merged PRs 0 in 61 days

01

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 15Sep 23Oct 1Oct 9Oct 17Oct 25Nov 2Nov 10
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Tue, Sep 15, 2026+1+00
Wed, Sep 16, 2026+0+00
Thu, Sep 17, 2026+0+00
Fri, Sep 18, 2026+0+00
Sat, Sep 19, 2026+0+00
Sun, Sep 20, 2026+0+00
Mon, Sep 21, 2026+0+00
Tue, Sep 22, 2026+0+00
Wed, Sep 23, 2026+0+00
Thu, Sep 24, 2026+0+00
Fri, Sep 25, 2026+0+00
Sat, Sep 26, 2026+0+00
Sun, Sep 27, 2026+0+00
Mon, Sep 28, 2026+0+00
Tue, Sep 29, 2026+0+00
Wed, Sep 30, 2026+0+00
Thu, Oct 1, 2026+0+00
Fri, Oct 2, 2026+0+00
Sat, Oct 3, 2026+0+00
Sun, Oct 4, 2026+0+00
Mon, Oct 5, 2026+0+00
Tue, Oct 6, 2026+0+00
Wed, Oct 7, 2026+0+00
Thu, Oct 8, 2026+0+00
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+0+00
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+0+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+0+00
Mon, Oct 19, 2026+0+00
Tue, Oct 20, 2026+0+00
Wed, Oct 21, 2026+0+00
Thu, Oct 22, 2026+0+00
Fri, Oct 23, 2026+0+00
Sat, Oct 24, 2026+0+00
Sun, Oct 25, 2026+0+00
Mon, Oct 26, 2026+0+00
Tue, Oct 27, 2026+0+00
Wed, Oct 28, 2026+1+00
Thu, Oct 29, 2026+0+00
Fri, Oct 30, 2026+0+00
Sat, Oct 31, 2026+0+00
Sun, Nov 1, 2026+0+00
Mon, Nov 2, 2026+0+00
Tue, Nov 3, 2026+0+00
Wed, Nov 4, 2026+0+00
Thu, Nov 5, 2026+0+00
Fri, Nov 6, 2026+0+00
Sat, Nov 7, 2026+0+00
Sun, Nov 8, 2026+0+00
Mon, Nov 9, 2026+0+00
Tue, Nov 10, 2026+0+00
Wed, Nov 11, 2026+0+00
Thu, Nov 12, 2026+0+00
Fri, Nov 13, 2026+0+00
Sat, Nov 14, 2026+0+00
Total+2+00
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Sep 221 post

    • Their finding that awareness drops sharply when grading isn't disclosed and that acting on it is rare is quite similar to what we observe in our evaluation also. Claude opus 5.5 system card:

      Read full on X, posted by @ChanglingXavier

      @ChanglingXavier · x.com

  2. 4 months earlier
  3. Jun 21 post

    • Our work on Decomposing and Measuring Evaluation Awareness was covered by @theinformation. Thanks @rocketalignment for the write-up! We position this work as the foundational reference for studying…

      Read full on X, posted by @ChanglingXavier

      @ChanglingXavier · x.com

  4. 8 days earlier
  5. May 252 posts

    • 🔍 We release our work on decomposing and measuring evaluation awareness in frontier LLMs, together with EvalAwareBench, a factor-controlled benchmark for measuring which environmental cues trigger…

      Read full on X, posted by @sahar_abdelnabi

      @sahar_abdelnabi · x.com

    • 💥 Today we release a new paper on decomposing and measuring evaluation awareness in frontier LLMs. We also release EvalAwareBench, a factor-controlled benchmark for measuring which environmental…

      Read full on X, posted by @maksym_andr

      @maksym_andr · x.com

You might also like

Repositories close to aisa-group/decomposing-eval-awareness
FeaturedAdvertise to 180K+ monthly visitors
Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Busbar

Control what AI can do before it acts

Websitebench

Can AI agents reverse-engineer real websites?

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

yinzhangyue/SelfAware

Python

Do Large Language Models Know What They Don’t Know?

1076

TIGER-AI-Lab/MMLU-Pro

Python

The code and data for "MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark" [NeurIPS 2024]

43359

safety-research/impossiblebench

Python

Official Inspect Implementation for "ImpossibleBench: Measuring LLMs' Propensity of Exploiting Test Cases"

8129

safety-research/bloom

Python

bloom - evaluate any behavior immediately  🌸🌱

1.4k177

carlini/yet-another-applied-llm-benchmark

Python

A benchmark to evaluate language models on questions I've previously asked them to solve.

1.1k79

UKGovernmentBEIS/inspect_ai

Python

Inspect: A framework for large language model evaluations

3.2k952

LiveBench/LiveBench

Python

LiveBench: A Challenging, Contamination-Free LLM Benchmark

1.4k136

microsoftarchive/promptbench

Python

A unified evaluation framework for large language models

2.8k226

ASTRAL-Group/MonitorBench

Python

[COLM 2026] Official implementation for "MonitorBench: A Comprehensive Benchmark for Chain-of-Thought Monitorability in Large Language Models"

283