wyann22/aios

100 days of LLM inference engineering — daily posts, experiments, and visualizations

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

Notes and exploration code for learning about AI/ML

Under the Hood - Build Every Layer of a Large Language Model from Scratch. A 36-project, build-it/break-it/measure-it manual by Ramchand Kumaresan.

learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen

Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.