xp2001-coder/zero2vllm

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

A small, educational vLLM implementation for exploring LLM inference, scheduling, KV-cache management, and GPU execution.

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

everything you need to know about inference engineering

Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.

Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.

100 days of LLM inference engineering — daily posts, experiments, and visualizations