amitshekhariitbhu/llm-inference-engineering

Everything you need to know about LLM inference

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

100 days of LLM inference engineering — daily posts, experiments, and visualizations

A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchmarking.

Based on Nano-vLLM, a simple replication of vLLM with self-contained paged attention and flash attention implementation

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

Curated collection of AI inference engineering resources — LLM serving, GPU kernels, quantization, distributed inference, and production deployment. Compiled from the AER Labs community.

Learn LLM internals step by step - from tokenization to attention to inference optimization.