Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost

troed/llama.cpp-adaptive-kv-streaming

LLM inference in C/C++

#LLM inference
Visit GitHub
C++
39
5
0
MIT License
website
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast troed/llama.cpp-adaptive-kv-streaming is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 12 – Nov 5, 2026

Stars +40 in 55 days

0510
8

Forks +5 in 55 days

01
1

Merged PRs 18 in 55 days

012
2

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 12Sep 19Sep 26Oct 3Oct 10Oct 17Oct 24Oct 31
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sat, Sep 12, 2026+0+00
Sun, Sep 13, 2026+2+01
Mon, Sep 14, 2026+2+00
Tue, Sep 15, 2026+3+00
Wed, Sep 16, 2026+1+10
Thu, Sep 17, 2026+1+00
Fri, Sep 18, 2026+0+00
Sat, Sep 19, 2026+0+01
Sun, Sep 20, 2026+0+00
Mon, Sep 21, 2026+0+00
Tue, Sep 22, 2026+0+00
Wed, Sep 23, 2026+0+00
Thu, Sep 24, 2026+8+10
Fri, Sep 25, 2026+4+00
Sat, Sep 26, 2026+0+00
Sun, Sep 27, 2026+2+01
Mon, Sep 28, 2026+1+01
Tue, Sep 29, 2026+2+02
Wed, Sep 30, 2026+1+00
Thu, Oct 1, 2026+1+02
Fri, Oct 2, 2026+1+01
Sat, Oct 3, 2026+0+01
Sun, Oct 4, 2026+1+00
Mon, Oct 5, 2026+0+00
Tue, Oct 6, 2026+0+00
Wed, Oct 7, 2026+1+00
Thu, Oct 8, 2026+2+11
Fri, Oct 9, 2026+0+11
Sat, Oct 10, 2026+1+01
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+1+01
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+0+01
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+0+01
Mon, Oct 19, 2026+0+00
Tue, Oct 20, 2026+1+00
Wed, Oct 21, 2026+1+00
Thu, Oct 22, 2026+0+00
Fri, Oct 23, 2026+0+00
Sat, Oct 24, 2026+0+00
Sun, Oct 25, 2026+0+00
Mon, Oct 26, 2026+1+00
Tue, Oct 27, 2026+0+00
Wed, Oct 28, 2026+0+00
Thu, Oct 29, 2026+0+00
Fri, Oct 30, 2026+1+00
Sat, Oct 31, 2026+0+10
Sun, Nov 1, 2026+0+00
Mon, Nov 2, 2026+0+02
Tue, Nov 3, 2026+0+00
Wed, Nov 4, 2026+1+00
Thu, Nov 5, 2026+0+00
Total+40+518
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Sep 291 post

    • RTX 5070 Ti, Qwen3.8-27B IQ4_XS at 256K: KV history in pinned RAM, no MTP, 8.73 tok/s. vs. draft-3 MTP, 19.12 tok/s for the same 256-token continuation. One run, but a neat gap to retest.

      Read full on X, posted by @sakurayukiai

      @sakurayukiai · x.com

  2. 16 days earlier
  3. Sep 131 post

    • Qwen 3.8 27B UD-IQ4_XS even faster on 16GB CUDA

      Read full on Reddit

      r/LocalLLaMA

You might also like

Repositories close to troed/llama.cpp-adaptive-kv-streaming
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

RaymondHuang210129/llama.cpp-adaptive-kv-streaming

C++

LLM inference in C/C++

46961

kvmem/kvmem

C++

KVMem virtualizes KV memory across inference backends to make ultra-long-context local AI accessible on limited hardware.

1.3k118

Anbeeld/beellama.cpp

C++

KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM

1.2k100

spiritbuun/buun-llama-cpp

C++

Experimental llama.cpp fork for inference research and development

899107

0xSero/turboquant

Python

TurboQuant: Near-optimal KV cache quantization for LLM inference (3-bit keys, 2-bit values) with Triton kernels + vLLM integration

1.8k205

OrbitInfra/OrbitKV

Rust

High Performance KV Cache for LLM Inference

27319

microsoft/RetrievalAttention

Python

[VLDB 26, NeurIPS 25] Scalable long-context LLM decoding that leverages sparsity—by treating the KV cache as a vector storage system.

15337

GenerelSchwerz/llama.cpp

C++

LLM inference in C/C++

14931

Omc12/Differential-KV

Python

Differential-KV (DKV) is a sparse KV-cache inference runtime designed for high-efficiency, memory-bounded long-context Large Language Model (LLM) inference across Apple Silicon (MLX) and CUDA GPUs.

214