hzg0601/LLM-Algorithm-Stack_Training-and-Inferring

everything you need to know about inference engineering

Source code repo for book: Hands-On LLM Serving and Optimization: Hosting LLMs at Scale

A Practitioner handbook for production llm serving.

Everything you need to know about LLM inference

深入剖析大语言模型架构、原理到训练部署 | How LLM works, including Design, Architecture and Training details.

A free textbook on building an LLM inference stack from scratch in Rust.

Machine Learning Engineering Open Book

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.