harleyszhang/llm_note

100 days of LLM inference engineering — daily posts, experiments, and visualizations

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

Everything you need to know about LLM inference

learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen

LLM algorithm practice lab with theory, solutions, and test cases.《大模型算法与系统教程》面向大模型入门到进阶的算法实战教程，覆盖原理讲解、答案解析、测试用例与 CUDA/Triton 实战。

Learn LLM internals step by step - from tokenization to attention to inference optimization.

~1300 line, minimal, extensible LLM inference engine built from scratch.

Experimental llama.cpp fork for inference research and development

LLM training in simple, raw C/CUDA