akitaonrails/llm-coding-benchmark

LLM Arena by KCORES team

Find, benchmark and install in CLI 170+ FREE coding LLM models across 15+ providers in real time

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024

Code for the paper "Evaluating Large Language Models Trained on Code"

A comprehensive code domain benchmark review of LLM researches.

Test LLMs on real tasks. Compare models side-by-side.

Compare compatible open-source local LLM projects by their metrics to assess popularity and activeness.

A benchmark to evaluate language models on questions I've previously asked them to solve.