Signal
Advertise
Signal
Advertise
Sign in
Submit
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
Log in
aisa-group/decomposing-eval-awareness — GitHub trending stats & insights | Trendshift
Bifrost
Omnigraph
aisa-group/decomposing-eval-awareness
#
NLP
Decomposing and measuring evaluation awareness in existing benchmarks and our proposed EvalAwareBench.
Visit GitHub
Like aisa-group/decomposing-eval-awareness, 0 likes
0
Bookmark aisa-group/decomposing-eval-awareness, 0 bookmarks
0
Python
20
4
1 contributors
Custom license
website
Social mentions
Recent discussions about this repository across the web
Their finding that awareness drops sharply when grading isn't disclosed and that acting on it is rare is quite similar to what we observe in our evaluation also. Claude opus 5.5 system card:
@ChanglingXavier · x.com
Our work on Decomposing and Measuring Evaluation Awareness was covered by @theinformation. Thanks @rocketalignment for the write-up! We position this work as the foundational reference for studying…
@ChanglingXavier · x.com
🔍 We release our work on decomposing and measuring evaluation awareness in frontier LLMs, together with EvalAwareBench, a factor-controlled benchmark for measuring which environmental cues trigger…
@sahar_abdelnabi · x.com
💥 Today we release a new paper on decomposing and measuring evaluation awareness in frontier LLMs. We also release EvalAwareBench, a factor-controlled benchmark for measuring which environmental…
@maksym_andr · x.com
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues