Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

It's a plan
It's a plan
Omnigraph
Omnigraph
OfinTech Desk
OfinTech Desk
Bifrost
Bifrost
Busbar
Busbar

varjoranta/turboquant-vllm

TurboQuant+ KV cache compression for vLLM. 3.8x smaller KV cache, same conversation quality. Fused CUDA kernels with automatic PyTorch fallback.

#LLM inference
Visit GitHub
Python
82
14
8 contributors
MIT License
FeaturedAdvertise to 180K+ monthly visitors
It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Busbar

Control what AI can do before it acts

Momentum

How fast varjoranta/turboquant-vllm is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 21 – Nov 20, 2026

Stars +3 in 61 days

01
1

Forks +1 in 61 days

01
1

Merged PRs 1 in 61 days

01
1

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 21Sep 29Oct 7Oct 15Oct 23Oct 31Nov 8Nov 16
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Mon, Sep 21, 2026+1+00
Tue, Sep 22, 2026+0+00
Wed, Sep 23, 2026+0+00
Thu, Sep 24, 2026+0+00
Fri, Sep 25, 2026+0+00
Sat, Sep 26, 2026+0+00
Sun, Sep 27, 2026+0+00
Mon, Sep 28, 2026+0+00
Tue, Sep 29, 2026+0+00
Wed, Sep 30, 2026+0+00
Thu, Oct 1, 2026+0+00
Fri, Oct 2, 2026+0+00
Sat, Oct 3, 2026+1+10
Sun, Oct 4, 2026+0+00
Mon, Oct 5, 2026+0+00
Tue, Oct 6, 2026+0+00
Wed, Oct 7, 2026+0+00
Thu, Oct 8, 2026+0+00
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+1+00
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+0+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+0+00
Mon, Oct 19, 2026+0+00
Tue, Oct 20, 2026+0+00
Wed, Oct 21, 2026+0+00
Thu, Oct 22, 2026+0+00
Fri, Oct 23, 2026+0+00
Sat, Oct 24, 2026+0+00
Sun, Oct 25, 2026+0+00
Mon, Oct 26, 2026+0+00
Tue, Oct 27, 2026+0+00
Wed, Oct 28, 2026+0+00
Thu, Oct 29, 2026+0+00
Fri, Oct 30, 2026+0+00
Sat, Oct 31, 2026+0+00
Sun, Nov 1, 2026+0+00
Mon, Nov 2, 2026+0+00
Tue, Nov 3, 2026+0+00
Wed, Nov 4, 2026+0+00
Thu, Nov 5, 2026+0+00
Fri, Nov 6, 2026+0+01
Sat, Nov 7, 2026+0+00
Sun, Nov 8, 2026+0+00
Mon, Nov 9, 2026+0+00
Tue, Nov 10, 2026+0+00
Wed, Nov 11, 2026+0+00
Thu, Nov 12, 2026+0+00
Fri, Nov 13, 2026+0+00
Sat, Nov 14, 2026+0+00
Sun, Nov 15, 2026+0+00
Mon, Nov 16, 2026+0+00
Tue, Nov 17, 2026+0+00
Wed, Nov 18, 2026+0+00
Thu, Nov 19, 2026+0+00
Fri, Nov 20, 2026+0+00
Total+3+11
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Sep 241 post
    • Before upgrading the GPU, check whether your quantized MoE unpacks experts it never uses. A repo's eager-mode H100 test got 8.4x faster Qwen3-30B-A3B decode by skipping them.

      Read full on X, posted by @sakurayukiai

      @sakurayukiai · x.com

You might also like

Repositories close to varjoranta/turboquant-vllm
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

vllm-project/llm-compressor

Python

State-of-the-art LLM compression, built for production inference with vLLM

4k754

0xSero/turboquant

Python

TurboQuant: Near-optimal KV cache quantization for LLM inference (3-bit keys, 2-bit values) with Triton kernels + vLLM integration

1.8k206

ModelCloud/GPTQModel

Python

LLM model quantization (compression) toolkit with HW acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU, Tenstorrent, Huawei Ascent NPU, and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

1.3k222

Dynamis-Labs/spectralquant

Python

SpectralQuant: Calibrated Eigenbasis Rotation and Water-Filled Bit Allocation for KV-Cache Compression

20423

NVIDIA/kvpress

Python

LLM KV cache compression made easy

1.3k211

DevTechJr/turboquant-gpu

Python
30733

AtomicBot-ai/atomic-llama-cpp-turboquant

C++

llama.cpp fork with TurboQuant WHT-rotated KV cache & weight compression + Gemma 4 MTP and Qwen 3.6 NextN speculative decoding (+30-50% throughput).

43372

FujitsuResearch/OneCompression

Python

Python package for LLM compression

44623

General-Instinct/InstinctRazor

Python

An Efficient Compression Framework for LLM

708