harshuljain13/llm-inference-at-scale

Everything you need to know about LLM inference

A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchmarking.

100 days of LLM inference engineering — daily posts, experiments, and visualizations

Scale LLM Engine public repository

Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.

A high-throughput and memory-efficient inference and serving engine for LLMs

Curated collection of AI inference engineering resources — LLM serving, GPU kernels, quantization, distributed inference, and production deployment. Compiled from the AER Labs community.

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).