noonghunna/benchlocal-cli

Benchmark your local LLMs with real evaluation suites. Not vibes - actual scores.

Local-first CLI for benchmarking LLMs on real hardware — quality, speed, reliability, and a real multi-turn agent loop.

🏎️ Dead-simple LLM benchmarking CLI - latency, cost, and quality metrics

Benchmark your local LLMs: speed, memory, and quality, in one command. TUI leaderboard for Ollama, LM Studio, llama.cpp, and vLLM.

Test LLMs on real tasks. Compare models side-by-side.

Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, and structured output. Supports vLLM, SGLang, and llama.cpp.

Provider-agnostic, open-source evaluation infrastructure for language models

Comprehensive LLM evaluation at scale: A production-ready framework for evaluating large language models across multiple benchmarks.

discover LLMs punching above their weight