Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
AxiomCode
AxiomCode
Busbar
Busbar
Bifrost
Bifrost

geoffwatts/ninfer-v100

High-performance single-GPU inference for selected model checkpoints and GPUs.

#LLM inference
Visit GitHub
C++
241
36
0
Apache License 2.0
FeaturedAdvertise to 180K+ monthly visitors
AxiomCode

Give Al Agents a Deeper Understanding of Your Codebase with a Code Graph

Busbar

Control what AI can do before it acts

Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

Momentum

How fast geoffwatts/ninfer-v100 is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Aug 24 – Oct 19, 2026

Stars +237 in 57 days

01020
17

Forks +36 in 57 days

0246
5

Merged PRs 1 in 57 days

01
1

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Aug 24Sep 1Sep 9Sep 17Sep 25Oct 3Oct 11Oct 19
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Mon, Aug 24, 2026+0+00
Tue, Aug 25, 2026+4+10
Wed, Aug 26, 2026+7+00
Thu, Aug 27, 2026+3+10
Fri, Aug 28, 2026+3+00
Sat, Aug 29, 2026+4+00
Sun, Aug 30, 2026+3+00
Mon, Aug 31, 2026+0+00
Tue, Sep 1, 2026+3+11
Wed, Sep 2, 2026+4+10
Thu, Sep 3, 2026+2+00
Fri, Sep 4, 2026+1+10
Sat, Sep 5, 2026+1+00
Sun, Sep 6, 2026+1+00
Mon, Sep 7, 2026+6+10
Tue, Sep 8, 2026+2+10
Wed, Sep 9, 2026+5+00
Thu, Sep 10, 2026+3+10
Fri, Sep 11, 2026+7+10
Sat, Sep 12, 2026+7+00
Sun, Sep 13, 2026+3+10
Mon, Sep 14, 2026+11+10
Tue, Sep 15, 2026+17+00
Wed, Sep 16, 2026+15+20
Thu, Sep 17, 2026+10+00
Fri, Sep 18, 2026+9+20
Sat, Sep 19, 2026+5+30
Sun, Sep 20, 2026+4+00
Mon, Sep 21, 2026+4+00
Tue, Sep 22, 2026+5+20
Wed, Sep 23, 2026+8+20
Thu, Sep 24, 2026+2+10
Fri, Sep 25, 2026+4+10
Sat, Sep 26, 2026+5+00
Sun, Sep 27, 2026+5+00
Mon, Sep 28, 2026+9+50
Tue, Sep 29, 2026+2+10
Wed, Sep 30, 2026+1+00
Thu, Oct 1, 2026+4+00
Fri, Oct 2, 2026+2+10
Sat, Oct 3, 2026+1+10
Sun, Oct 4, 2026+6+10
Mon, Oct 5, 2026+3+00
Tue, Oct 6, 2026+2+00
Wed, Oct 7, 2026+1+00
Thu, Oct 8, 2026+7+00
Fri, Oct 9, 2026+7+00
Sat, Oct 10, 2026+0+10
Sun, Oct 11, 2026+3+10
Mon, Oct 12, 2026+3+00
Tue, Oct 13, 2026+2+00
Wed, Oct 14, 2026+4+00
Thu, Oct 15, 2026+2+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+2+10
Sun, Oct 18, 2026+3+00
Mon, Oct 19, 2026+0+00
Total+237+361
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Sep 111 post

    • 218 tok/s Qwen3.8-27B on a single PCIe V100 32GB

      Read full on Reddit

      r/LocalLLM

  2. 17 days earlier
  3. Aug 251 post

    • 想用 V100 本地部署 qwen-3.8-2.7B 的，可以看一下这个代码库（ V100 做了优化。我实测了一下，可以到 50 tps 的 decode 速度，美中不足的就是上下文窗口比较短，处理复杂编程有点费劲

      Read full on X, posted by @LeonardChen16

      @LeonardChen16 · x.com

You might also like

Repositories close to geoffwatts/ninfer-v100
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

AxiomCode

Give Al Agents a Deeper Understanding of Your Codebase with a Code Graph

Neroued/ninfer

C++

High-performance single-GPU inference for selected model checkpoints and GPUs.

3.1k359

natpate/ninfer-windows

C++

High-performance single-GPU inference for selected model checkpoints and GPUs.

18222

naklecha/simple-llm

Python

~1300 line, minimal, extensible LLM inference engine built from scratch.

49138

1CatAI/1Cat-vLLM

Python

V100 / SM70-focused vLLM engineering fork for modern LLM inference.

1.4k256

Don-Chad/ninfer-3090

C++

Hyper optimised Qwen3.8-27B inference on one RTX 3090: ReplaySSM, MTP3, reasoning effort, C1-C8 batching, and native Windows and Linux builds.

46053

Tiiny-AI/PowerInfer

C++

High-speed Large Language Model Serving for Local Deployment

9.8k646

UDPSendToFailed/ninfer-4090

C++

NInfer port for Qwen 3.8 27B on RTX 4090

18027

dnv2003/v100-skinny

Python

Hand-written NVFP4 W4A16 CUDA kernels for Volta

17526

ashhart/TensorFold

Zig

LLM Inference Engine for Metal and CUDA.

1.4k255