alvarobartt/hf-mem

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

Can I Run AI

Hundreds of models & providers. One command to find what runs on your hardware.

Single-GPU LLM fine-tuning preflight: memory estimates, runnable LoRA/QLoRA recipes, and local measurements.

Advanced CLI tool that scans your hardware and tells you exactly which LLM or sLLM models you can run locally, with full Ollama integration.

A library for mechanistic interpretability of GPT-style language models

Large-scale LLM inference engine

The official API server for Exllama. OAI compatible, lightweight, and fast.