AnkitNayak-dev/llmBench

Local-first CLI for benchmarking LLMs on real hardware — quality, speed, reliability, and a real multi-turn agent loop.

Benchmark your local LLMs: speed, memory, and quality, in one command. TUI leaderboard for Ollama, LM Studio, llama.cpp, and vLLM.

📊 LLM Context Benchmarks - A comprehensive benchmarking tool for testing LLMs with varying context sizes using Ollama. Features dual benchmark modes (API/CLI), automatic hardware detection (optimized for Apple Silicon), visual performance charts.

llama-benchy - llama-bench style benchmarking tool for all backends

Local LLM Inference Speed Test Tool

LocalScore is an open benchmark which helps you understand how well your computer can handle local AI tasks.

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

Benchmark and optimize LLM inference across frameworks with ease

Benchmark your local LLMs with real evaluation suites. Not vibes - actual scores.