Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost

localai-org/vllm.cpp

a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)

#LLM inference
Visit GitHub
C++
479
65
3 contributors
Apache License 2.0
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast localai-org/vllm.cpp is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 6 – Nov 5, 2026

Stars +93 in 61 days

0510
10

Forks +9 in 61 days

01
1

Merged PRs 371 in 61 days

0102030
24

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 6Sep 14Sep 22Sep 30Oct 8Oct 16Oct 24Nov 1
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sun, Sep 6, 2026+1+019
Mon, Sep 7, 2026+2+01
Tue, Sep 8, 2026+2+07
Wed, Sep 9, 2026+1+02
Thu, Sep 10, 2026+1+05
Fri, Sep 11, 2026+0+013
Sat, Sep 12, 2026+1+019
Sun, Sep 13, 2026+4+17
Mon, Sep 14, 2026+3+03
Tue, Sep 15, 2026+10+010
Wed, Sep 16, 2026+7+05
Thu, Sep 17, 2026+0+01
Fri, Sep 18, 2026+1+015
Sat, Sep 19, 2026+1+08
Sun, Sep 20, 2026+1+111
Mon, Sep 21, 2026+2+015
Tue, Sep 22, 2026+2+011
Wed, Sep 23, 2026+1+114
Thu, Sep 24, 2026+0+010
Fri, Sep 25, 2026+5+09
Sat, Sep 26, 2026+1+07
Sun, Sep 27, 2026+2+124
Mon, Sep 28, 2026+2+00
Tue, Sep 29, 2026+1+03
Wed, Sep 30, 2026+1+00
Thu, Oct 1, 2026+0+03
Fri, Oct 2, 2026+1+09
Sat, Oct 3, 2026+0+014
Sun, Oct 4, 2026+2+03
Mon, Oct 5, 2026+3+00
Tue, Oct 6, 2026+1+04
Wed, Oct 7, 2026+0+06
Thu, Oct 8, 2026+0+09
Fri, Oct 9, 2026+2+06
Sat, Oct 10, 2026+0+09
Sun, Oct 11, 2026+0+07
Mon, Oct 12, 2026+0+03
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+2+02
Fri, Oct 16, 2026+2+01
Sat, Oct 17, 2026+0+012
Sun, Oct 18, 2026+1+01
Mon, Oct 19, 2026+0+08
Tue, Oct 20, 2026+1+05
Wed, Oct 21, 2026+0+05
Thu, Oct 22, 2026+2+18
Fri, Oct 23, 2026+0+04
Sat, Oct 24, 2026+2+11
Sun, Oct 25, 2026+2+03
Mon, Oct 26, 2026+2+03
Tue, Oct 27, 2026+0+00
Wed, Oct 28, 2026+5+04
Thu, Oct 29, 2026+5+18
Fri, Oct 30, 2026+2+03
Sat, Oct 31, 2026+1+15
Sun, Nov 1, 2026+1+03
Mon, Nov 2, 2026+2+00
Tue, Nov 3, 2026+0+01
Wed, Nov 4, 2026+1+02
Thu, Nov 5, 2026+1+10
Total+93+9371
  • 1#1 on the list
  • 7Rank that day
  • Not trending

    • Mentions and achievements

    Where people are talking about localai-org/vllm.cpp, and every badge it has earned
    1. Sep 241 post

      • Laya:

        Read full on X, posted by @mudler_it

        @mudler_it · x.com

    2. 9 days earlier
    3. Sep 151 post

      • EXL3 in vllm.cpp, on @NVIDIARTXSpark and @AIatAMD. Max concurrency achieved! GB10, Qwen3.8-27B + DFlash2: 53.93 vs 32.84 tok/s at c8 -> 1.64× exllamav3. Across c1/c4/c8/c16/c32: 1.08× / 1.61× / 1.64×…

        Read full on X, posted by @mudler_it

        @mudler_it · x.com

    4. 1 month earlier
    5. Aug 81 post

      • a 118B model on one DGX Spark, in 4-bit, and vllm.cpp is ahead of vLLM on it 44.46 tok/s against vLLM's 43.10 on @poolsideai's Laguna-S-2.1. same output, token for token. default config, nothing to…

        Read full on X, posted by @mudler_it

        @mudler_it · x.com

    6. Aug 62 posts

      • C++ Version of vLLM

        Read full on Hacker News

        Hacker News

      • I ported vLLM's serving stack to C++20: 66 MiB binary, no Python at inference, output checked token-for-token against vLLM

        Read full on Reddit

        r/LocalLLaMA

    7. Aug 52 posts

      • vllm.cpp mirrors vLLM by default, but some of the good scheduling ideas I always fancied are sglang's, so vllm.cpp supports different set of features: --enable-radix-attention (fused into the…

        Read full on X, posted by @mudler_it

        @mudler_it · x.com

      • been writing a C++20 port of vLLM for a while now, and was quite silent on it, because I don't like to talk until I have results. So I was in "cave mode". Name TBD. Until then it's vllm.cpp paged KV…

        Read full on X, posted by @mudler_it

        @mudler_it · x.com

    8. Aug 31 post

      • LocalAI unveils vllm.cpp, a 66 MB C++ inference server It contains - continuous batching - tool calling - structured output - an OpenAI-compatible API So basically we truly have AI in our pockets now

        Read full on X, posted by @Zenul_Abidin

        @Zenul_Abidin · x.com

    You might also like

    Repositories close to localai-org/vllm.cpp
    FeaturedAdvertise to 180K+ monthly visitors
    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    ifm-ai/llama.cpp

    LLM inference in C/C++

    2618

    google/gemma.cpp

    C++

    lightweight, standalone C++ inference engine for Google's Gemma models.

    7.1k685

    kishida/llama.cpp

    LLM inference in C/C++

    243

    am17an/llama.cpp

    C++

    LLM inference in C/C++

    5722

    fairydreaming/llama.cpp

    C++

    LLM inference in C/C++

    304

    pwilkin/llama.cpp

    C++

    LLM inference in C/C++

    4112

    ggml-org/llama.cpp

    C++

    LLM inference in C/C++

    133.4k22.4k

    QuinsZouls/llama-cpp-turboquant

    C++

    Experimental LLM inference in C/C++

    387

    thecodacus/llama.cpp

    C++

    LLM inference in C/C++

    363117