gpustack/gguf-parser-go

A CLI to estimate inference memory requirements for Hugging Face models, written in Python.

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

gguf node for comfyui

A library for mechanistic interpretability of GPT-style language models

Can I Run AI

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

LLM Benchmark for Throughput via Ollama (Local LLMs)

Utilities intended for use with Llama models.

Hundreds of models & providers. One command to find what runs on your hardware.