evalplus/evalplus

Code for the paper "Evaluating Large Language Models Trained on Code"

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

The LLM Evaluation Framework

SWE-bench: Can Language Models Resolve Real-world Github Issues?

Skills for AI Evals to compliment the course: AI Evals For Engineers & PMs

Inspect: A framework for large language model evaluations

Official implementation for the paper: "Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering""

[ICML'24] Magicoder: Empowering Code Generation with OSS-Instruct

bloom - evaluate any behavior immediately  🌸🌱