Decomposing and measuring evaluation awareness in existing benchmarks and our proposed EvalAwareBench.
LiveBench: A Challenging, Contamination-Free LLM Benchmark
Code and data for the paper: On the Humanity of Conversational AI: Evaluating the Psychological Portrayal of LLMs
SIRIN is a Python library for detecting and analyzing contextual inconsistencies in systems that use LLMs
[JMLR 2026] UQLM: A Python package for LLM hallucination detection using uncertainty quantification
bloom - evaluate any behavior immediately 🌸🌱
Metacognition in LLMs: Foundations, Progress, and Opportunities
Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasoning elevation🍓 and hallucination alleviation🍄.
The LLM Evaluation Framework
