alexziskind1/codeneedle

Code for the paper "Evaluating Large Language Models Trained on Code"

SWE-bench: Can Language Models Resolve Real-world Github Issues?

Measuring frontier coding agents on original, long-horizon engineering tasks

Qwen3-Coder is the code version of Qwen3, the large language model series developed by Qwen team.

SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?

official repository of aiXcoder-7B Code Large Language Model

Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024

Can Language Models Rebuild Programs From Scratch?

A benchmark to evaluate language models on questions I've previously asked them to solve.