Signal
Advertise
Signal
Advertise
Sign in
Submit
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
Log in
bojieli/ai-infra-book — GitHub trending stats & insights | Trendshift
VModal Mobile SDK
Busbar
open-connector
bojieli/ai-infra-book
《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
Visit GitHub
Like bojieli/ai-infra-book, 0 likes
0
Bookmark bojieli/ai-infra-book, 0 bookmarks
0
Python
1.9k
108
3 contributors
Apache License 2.0
website
Social mentions
Recent discussions about this repository across the web
为什么一次推理会慢,常常不是“模型不够快”,而是算力、显存、带宽和通信中的某一项先撞墙。 这本书让我更清楚地理解 AI Infra 不是参数调优的背景板,而是从硬件约束反推模型与系统设计。它把 KV 缓存、算子、超节点、网络、训练和调度串成一条量化链路,还附了可复算的计算工具与实验。
@vintcessun · x.com
为什么同一模型换了硬件、上下文长度或并发,成本和延迟会差出数量级? 这本开源书让我重新理解 AI Infra:不是背优化名词,而是从算力、显存、带宽和通信约束出发,逐项量化推导。KV Cache、算子、超节点到调度都有计算工具和实验;先算物理上限,再找系统损耗,很多“优化经验”终于有了判断坐标。
@vintcessun · x.com
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues