Reach 125K+ monthly visitors
Advertise on Trendshiftztxz16/fastllm
fastllm是后端无依赖的高性能大模型推理库。同时支持张量并行推理稠密模型和混合模式推理MOE模型，任意10G以上显卡即可推理满血DeepSeek。双路9004/9005服务器+单显卡部署DeepSeek满血满精度原版模型，单并发20tps；INT4量化模型单并发30tps，多并发可达60+。
C++
4.8k
474
53 contributors
Apache License 2.0
Achievements
Trendshift snapshots GitHub's daily Trending list and runs its own trending list. The dynamic badges below mark the best position this repository has reached on each platform. They refresh automatically as its position climbs
GitHub Trending
ztxz16/fastllm has been featured on GitHub Trending, first reaching #6 on Mar 22, 2024
Trendshift Trending
ztxz16/fastllm has trended on Trendshift's daily and weekly list
Daily
First achieved on 8th, May 2026 for C++
Weekly
First achieved in Week 19, 2026 for C++