Forge-the-Kingdom/llm-serve-dashboard

Live truecolor terminal dashboard for a locally running LLM: tok/s, TTFT, GPUs, context, MTP acceptance, layer and real expert routing (llama.cpp)

sparkDash ⚡ — Multi-DGX Spark Monitoring Dashboard

Real-time hardware and LLM inference monitoring — GPU, CPU, memory, and vLLM metrics streamed to a dashboard.

Control panel for VLLM, Sglang, llama.cpp, exllamav3

Open-source control panel for the real llama.cpp: see where a model lands in your VRAM before loading, every llama-server flag per model, one-click llama.cpp updates, several models at once, and Embers (local agents whose quotes are checked by code). Windows · Linux · macOS.

User friendly GUI for configuring and launching llama.cpp

Llama.cpp launcher with integrated huggingface