junuxyz/mlsys-notes

a personal collection of my notes for ml sys

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻 Video Tutorials.

Source code repo for book: Hands-On LLM Serving and Optimization: Hosting LLMs at Scale

100 days of LLM inference engineering — daily posts, experiments, and visualizations

My learning notes for ML SYS.

Everything you need to know about LLM inference

Curated collection of AI inference engineering resources — LLM serving, GPU kernels, quantization, distributed inference, and production deployment. Compiled from the AER Labs community.