RahulSChand/gpu_poor

GPU inference speed calculator — estimate theoretical tokens/s by GPU model, count & quantization

Check whether your GPU can run an Ollama model. Estimates VRAM, KV cache, tokens/sec and power for single and multi-GPU setups.

A static performance model for LLM inference: given (model, GPU, interconnect, workload), instantly answer VRAM feasibility, latency(TTFT, TPOT, ITL), and throughput.

A CLI to estimate inference memory requirements for Hugging Face models, written in Python.

Feel how fast a local LLM runs before you buy the hardware

Diagram-first LLM architecture, memory, hardware-fit, throughput, and verified cloud-cost explorer.

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

Hundreds of models & providers. One command to find what runs on your hardware.

Open CC BY 4.0 dataset: which local LLMs (Ollama) fit which hardware — params, quantization, RAM/VRAM. Powered by modelfit.io