aidatatools/ollama-benchmark

Test LLMs on real tasks. Compare models side-by-side.

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

llama-benchy - llama-bench style benchmarking tool for all backends

Advanced CLI tool that scans your hardware and tells you exactly which LLM or sLLM models you can run locally, with full Ollama integration.

Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, and structured output. Supports vLLM, SGLang, and llama.cpp.

Hundreds of models & providers. One command to find what runs on your hardware.

LLM plugin providing access to models running on an Ollama server