Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

Omnigraph
Omnigraph
Busbar
Busbar
It's a plan
It's a plan
OfinTech Desk
OfinTech Desk
Bifrost
Bifrost

roofkid/ninfer-4080

Qwen3.8-27B-GSQ3 on one RTX 4080: 100k context with rk4v4-e8, up to 2720 tok/s prefill and 262 tok/s generation

#LLM inference
Visit GitHub
C++
35
5
0
Apache License 2.0
FeaturedAdvertise to 180K+ monthly visitors
Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Busbar

Control what AI can do before it acts

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast roofkid/ninfer-4080 is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Oct 2 – Nov 19, 2026

Stars +35 in 49 days

051015
11

Forks +5 in 49 days

012
2

Merged PRs 0 in 49 days

01

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Oct 2Oct 9Oct 16Oct 23Oct 30Nov 6Nov 13
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Fri, Oct 2, 2026+0+00
Sat, Oct 3, 2026+2+00
Sun, Oct 4, 2026+11+10
Mon, Oct 5, 2026+3+00
Tue, Oct 6, 2026+3+00
Wed, Oct 7, 2026+2+00
Thu, Oct 8, 2026+1+00
Fri, Oct 9, 2026+3+00
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+3+00
Mon, Oct 12, 2026+1+00
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+0+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+20
Sun, Oct 18, 2026+0+00
Mon, Oct 19, 2026+0+00
Tue, Oct 20, 2026+0+00
Wed, Oct 21, 2026+0+00
Thu, Oct 22, 2026+0+00
Fri, Oct 23, 2026+0+00
Sat, Oct 24, 2026+0+00
Sun, Oct 25, 2026+0+00
Mon, Oct 26, 2026+1+00
Tue, Oct 27, 2026+0+00
Wed, Oct 28, 2026+1+10
Thu, Oct 29, 2026+0+00
Fri, Oct 30, 2026+1+00
Sat, Oct 31, 2026+0+10
Sun, Nov 1, 2026+1+00
Mon, Nov 2, 2026+0+00
Tue, Nov 3, 2026+0+00
Wed, Nov 4, 2026+0+00
Thu, Nov 5, 2026+0+00
Fri, Nov 6, 2026+0+00
Sat, Nov 7, 2026+0+00
Sun, Nov 8, 2026+0+00
Mon, Nov 9, 2026+0+00
Tue, Nov 10, 2026+0+00
Wed, Nov 11, 2026+0+00
Thu, Nov 12, 2026+0+00
Fri, Nov 13, 2026+0+00
Sat, Nov 14, 2026+0+00
Sun, Nov 15, 2026+0+00
Mon, Nov 16, 2026+1+00
Tue, Nov 17, 2026+0+00
Wed, Nov 18, 2026+1+00
Thu, Nov 19, 2026+0+00
Total+35+50
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Oct 31 post
    • I built Ninfer 4080 for 16GB class GPUs

      Read full on Reddit

      r/LocalLLaMA

You might also like

Repositories close to roofkid/ninfer-4080
FeaturedAdvertise to 180K+ monthly visitors
Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

Busbar

Control what AI can do before it acts

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

sergiuszm/ninfer-4090

C++

Qwen3.8-27B on one RTX 4090: full native 262K context via E8 4-bit KV, up to 149 tok/s code decode with MTP3, sm_89-retuned attention prefill, vision, llama.cpp-compatible /metrics + /slots

23943

UDPSendToFailed/ninfer-4090

C++

NInfer port for Qwen 3.8 27B on RTX 4090

18729

Don-Chad/ninfer-3090

C++

Hyper optimised Qwen3.8-27B inference on one RTX 3090: ReplaySSM, MTP3, reasoning effort, C1-C8 batching, and native Windows and Linux builds.

52358

kacper-daftcode/qwentin

Cuda

Qwen3.6/3.8-27B on one RTX 5090: 576K pooled context across 12 sessions at FP8-level quality from 5.75 bpw. EXL3 trellis weights, 4-bit trellis-coded KV, MTP spec-decode, paged batching, hand-written SM120 kernels, OpenAI API.

303

toddballinger/ninfer-5080

C++

Optimized NINFER runtime and reproducible Qwen3.8-27B true-128K inference for NVIDIA RTX 5080 16GB

5112

gzenz/ninfer

C++

High-performance single-GPU inference for selected model checkpoints and GPUs.

253

r0b0tlab/qwen38-exl3-dflash2

Python

Qwen3.8-27B EXL3 (4.00 bpw) + DFlash2 speculative decoding for ExLlamaV3, validated at 262k context on a 24 GB RTX 3090

253

Wallawalla47/Infernix

C++

C++/CUDA single-GPU inference engine for Qwen3.8 (incl. Qwen3.8-Flash-Next with offloaded experts) on the RTX 5090; grew from NInfer

30645

mr-september/ninfer-2080ti-22g

C++
8712