openai/human-eval

SWE-bench: Can Language Models Resolve Real-world Github Issues?

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

DeepSeek Coder: Let the Code Write Itself

A coding agent for open models like Kimi K3 and GLM 5.3

Inference code for CodeLlama models

Give your agents the power of the Hugging Face ecosystem

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

Official implementation for the paper: "Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering""

The power of Claude Code / GeminiCLI / CodexCLI + [Gemini / OpenAI / OpenRouter / Azure / Grok / Ollama / Custom Model / All Of The Above] working as one.