Featured
UDPSendToFailed/ninfer-4090
Fast Qwen3.8-27B inference on one RTX 3090: ReplaySSM, MTP3, reasoning effort, C1-C8 batching, and native Windows and Linux builds.
C++
66
8
Apache License 2.0
Trendshift snapshots GitHub's daily Trending list and runs its own trending list
Trendshift Trending
UDPSendToFailed/ninfer-4090 has trended on Trendshift's daily list
Daily
First achieved on 17th, Aug 2026 for C++