Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

Bifrost
Bifrost

toddballinger/ninfer-5080

Optimized NINFER runtime and reproducible Qwen3.8-27B true-128K inference for NVIDIA RTX 5080 16GB

#LLM inference
Visit GitHub
C++
42
11
0
Apache License 2.0
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

Momentum

How fast toddballinger/ninfer-5080 is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 15 – Oct 26, 2026

Stars +33 in 42 days

024
4

Forks +11 in 42 days

012
2

Merged PRs 45 in 42 days

051015
12

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 15Sep 21Sep 27Oct 3Oct 9Oct 15Oct 21
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Tue, Sep 15, 2026+0+10
Wed, Sep 16, 2026+0+00
Thu, Sep 17, 2026+0+00
Fri, Sep 18, 2026+0+10
Sat, Sep 19, 2026+0+01
Sun, Sep 20, 2026+0+07
Mon, Sep 21, 2026+0+01
Tue, Sep 22, 2026+4+21
Wed, Sep 23, 2026+1+01
Thu, Sep 24, 2026+2+01
Fri, Sep 25, 2026+1+11
Sat, Sep 26, 2026+2+02
Sun, Sep 27, 2026+0+20
Mon, Sep 28, 2026+2+05
Tue, Sep 29, 2026+2+14
Wed, Sep 30, 2026+0+01
Thu, Oct 1, 2026+0+00
Fri, Oct 2, 2026+1+00
Sat, Oct 3, 2026+0+00
Sun, Oct 4, 2026+4+00
Mon, Oct 5, 2026+1+00
Tue, Oct 6, 2026+0+00
Wed, Oct 7, 2026+0+00
Thu, Oct 8, 2026+0+10
Fri, Oct 9, 2026+1+04
Sat, Oct 10, 2026+3+012
Sun, Oct 11, 2026+1+04
Mon, Oct 12, 2026+1+00
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+1+10
Thu, Oct 15, 2026+1+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+10
Sun, Oct 18, 2026+2+00
Mon, Oct 19, 2026+0+00
Tue, Oct 20, 2026+1+00
Wed, Oct 21, 2026+0+00
Thu, Oct 22, 2026+1+00
Fri, Oct 23, 2026+1+00
Sat, Oct 24, 2026+0+00
Sun, Oct 25, 2026+0+00
Mon, Oct 26, 2026+0+00
Total+33+1145
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Sep 222 posts
    • Qwen3.8-27B at true 128K + Vision on a single RTX 5080 16GB — NInfer v1.3, MTP-3, ~3.95 BPW, model now public

      Read full on Reddit

      r/Qwen_AI

    • Qwen3.8-27B at true 128K + Vision on a single RTX 5080 16GB — NInfer v1.3, MTP-3, ~3.95 BPW, model now public

      Read full on Reddit

      r/LocalLLM

You might also like

Repositories close to toddballinger/ninfer-5080
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

sergiuszm/ninfer-4090

C++

Qwen3.8-27B on one RTX 4090: full native 262K context via E8 4-bit KV, up to 149 tok/s code decode with MTP3, sm_89-retuned attention prefill, vision, llama.cpp-compatible /metrics + /slots

21742

roofkid/ninfer-4080

C++

Qwen3.8-27B-GSQ3 on one RTX 4080: 100k context with rk4v4-e8, up to 2720 tok/s prefill and 262 tok/s generation

313

Don-Chad/ninfer-3090

C++

Hyper optimised Qwen3.8-27B inference on one RTX 3090: ReplaySSM, MTP3, reasoning effort, C1-C8 batching, and native Windows and Linux builds.

47555

UDPSendToFailed/ninfer-4090

C++

NInfer port for Qwen 3.8 27B on RTX 4090

18127

mr-september/ninfer-2080ti-22g

C++
8212

Doelfke/ninfer-yarn

C++

Crazy Fast Qwen3.8–27b With a 420k Context on an RTX 5090

401

r0b0tlab/qwen38-exl3-dflash2

Python

Qwen3.8-27B EXL3 (4.00 bpw) + DFlash2 speculative decoding for ExLlamaV3, validated at 262k context on a 24 GB RTX 3090

253

jpezzulli/sglang-rtxpro6000

Python

Optimized SGLang runtime for Qwen3.8-27B FP8 with DFlash2 and Qwen3.8 Flash-Next NVFP4 with FR-Spec on one NVIDIA RTX PRO 6000 Blackwell 96 GB GPU (SM120): 524K context, HiCache and NIXL.

17826

gzenz/ninfer

C++

High-performance single-GPU inference for selected model checkpoints and GPUs.

243