Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

Omnigraph
Omnigraph
Busbar
Busbar
OfinTech Desk
OfinTech Desk
It's a plan
It's a plan
Bifrost
Bifrost

Kmic-68/llama.cpp

llama.cpp tuned for 2x Tesla P100 (sm_60). Decode 1.86x, 3-4x with MTP (up to ~70 t/s on code). Prefill 2x, full 262k context with vision. More numerically accurate than upstream.

#LLM inference
Visit GitHub
C++
80
17
0
MIT License
website
FeaturedAdvertise to 180K+ monthly visitors
Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Busbar

Control what AI can do before it acts

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast Kmic-68/llama.cpp is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 20 – Nov 19, 2026

Stars +81 in 61 days

0246
6

Forks +17 in 61 days

0123
3

Merged PRs 14 in 61 days

0510
10

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 20Sep 28Oct 6Oct 14Oct 22Oct 30Nov 7Nov 15
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sun, Sep 20, 2026+3+00
Mon, Sep 21, 2026+0+10
Tue, Sep 22, 2026+0+00
Wed, Sep 23, 2026+0+00
Thu, Sep 24, 2026+1+00
Fri, Sep 25, 2026+1+10
Sat, Sep 26, 2026+0+00
Sun, Sep 27, 2026+3+00
Mon, Sep 28, 2026+3+00
Tue, Sep 29, 2026+1+00
Wed, Sep 30, 2026+2+00
Thu, Oct 1, 2026+0+10
Fri, Oct 2, 2026+0+10
Sat, Oct 3, 2026+0+00
Sun, Oct 4, 2026+0+10
Mon, Oct 5, 2026+0+10
Tue, Oct 6, 2026+0+00
Wed, Oct 7, 2026+0+00
Thu, Oct 8, 2026+1+00
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+0+00
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+1+00
Thu, Oct 15, 2026+1+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+1+02
Mon, Oct 19, 2026+1+00
Tue, Oct 20, 2026+0+00
Wed, Oct 21, 2026+0+00
Thu, Oct 22, 2026+0+00
Fri, Oct 23, 2026+0+00
Sat, Oct 24, 2026+0+00
Sun, Oct 25, 2026+0+010
Mon, Oct 26, 2026+1+00
Tue, Oct 27, 2026+0+00
Wed, Oct 28, 2026+1+10
Thu, Oct 29, 2026+1+00
Fri, Oct 30, 2026+1+10
Sat, Oct 31, 2026+2+00
Sun, Nov 1, 2026+2+00
Mon, Nov 2, 2026+5+00
Tue, Nov 3, 2026+1+10
Wed, Nov 4, 2026+5+10
Thu, Nov 5, 2026+4+10
Fri, Nov 6, 2026+3+00
Sat, Nov 7, 2026+2+02
Sun, Nov 8, 2026+1+00
Mon, Nov 9, 2026+4+10
Tue, Nov 10, 2026+4+10
Wed, Nov 11, 2026+3+00
Thu, Nov 12, 2026+3+00
Fri, Nov 13, 2026+3+00
Sat, Nov 14, 2026+2+00
Sun, Nov 15, 2026+2+00
Mon, Nov 16, 2026+1+00
Tue, Nov 17, 2026+6+00
Wed, Nov 18, 2026+4+30
Thu, Nov 19, 2026+1+10
Total+81+1714
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Oct 181 post
    • 2x Tesla p100s, q6_k quant, Qwen 3.8 27B ~60tps

      Read full on Hacker News

      Hacker News

  2. 21 days earlier
  3. Sep 271 post
    • 2x Tesla p100s, q6_k quant, Qwen 3.8 27B ~60tps V3.0

      Read full on Reddit

      r/LocalLLaMA

  4. Sep 261 post
    • 2x Tesla P100, q6_k quant 50+tps. V2.0

      Read full on Reddit

      r/LocalLLM

  5. 7 days earlier
  6. Sep 191 post
    • 2x tesla p100, qwen 3.8 27B (q6_k quant) at 40+tps

      Read full on Reddit

      r/LocalLLM

You might also like

Repositories close to Kmic-68/llama.cpp
FeaturedAdvertise to 180K+ monthly visitors
OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

Busbar

Control what AI can do before it acts

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

1115714829/llama.cpp-v100

C++

llama.cpp optimized for NVIDIA Tesla V100 (SM70). Qwen3.8-Flash-Next (MoE) with MTP on 1/2/3/6x V100-16GB at 262K context (6 GPUs: prefill 3402 tok/s at 200K; 2 GPUs on one socket: 2152 tok/s). Qwen3.8-27B with DFlash2 on 1-6 GPUs, up to 512K context. Multimodal, thinking, concurrent serving, built-in web UI.

8315

shinbunbun/llama-cpp-p100-patches

Nix

llama.cpp performance patches developed and measured on Tesla P100 (GP100, sm_60). Most are not Pascal-specific.

645

naklecha/simple-llm

Python

~1300 line, minimal, extensible LLM inference engine built from scratch.

49338

1CatAI/1Cat-vLLM

Python

V100 / SM70-focused vLLM engineering fork for modern LLM inference.

1.5k302

geoffwatts/ninfer-v100

C++

High-performance single-GPU inference for selected model checkpoints and GPUs.

27445

spiritbuun/buun-llama-cpp

C++

Experimental llama.cpp fork for inference research and development

910108

iamwavecut/ninfer-all

C++

One line of NInfer for the Blackwell, Ada Lovelace, Ampere, Turing and Volta NVIDIA GPUs, consolidated from the forks that carry it: GGUF block formats, ternary Bonsai 2, device route profiles, MTP and DFlash2.

23451

ifm-ai/llama.cpp

LLM inference in C/C++

2618

ggml-org/llama.cpp

C++

LLM inference in C/C++

135.7k23.2k