navaneethkrishnansuresh/Inference-Engineering

Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.

100 days of LLM inference engineering — daily posts, experiments, and visualizations

Everything you need to know about LLM inference

Source code repo for book: Hands-On LLM Serving and Optimization: Hosting LLMs at Scale

A Practitioner handbook for production llm serving.

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchmarking.