Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

Busbar
Busbar
OfinTech Desk
OfinTech Desk
It's a plan
It's a plan
Bifrost
Bifrost
Trina AX
Trina AX
Omnigraph
Omnigraph

flashinfer-ai/flashinfer

FlashInfer: Kernel Library for LLM Serving

Visit GitHub
Cuda
7k
1.8k
314 contributors
Apache License 2.0
website
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Trina AX

A self-hosted team AI workspace for company files, with per-person folder permissions

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Momentum

How fast flashinfer-ai/flashinfer is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 23 – Nov 22, 2026

Stars +503 in 61 days

02040
34

Forks +305 in 61 days

0510
10

Merged PRs 3,028 in 61 days

0100200
190

Trendshift Trendingwhere the repository ranked each day it made the top 25

Top 25 in Cuda

366966510443347412621122111127111126224563334322112351171117
Sep 23Oct 1Oct 9Oct 17Oct 25Nov 2Nov 10Nov 18
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRsCuda
Wed, Sep 23, 2026+13+527#3
Thu, Sep 24, 2026+5+520#6
Fri, Sep 25, 2026+2+317#6
Sat, Sep 26, 2026+2+224#9
Sun, Sep 27, 2026+4+226#6
Mon, Sep 28, 2026+6+622#6
Tue, Sep 29, 2026+7+337#5
Wed, Sep 30, 2026+2+529#10
Thu, Oct 1, 2026+5+527#4
Fri, Oct 2, 2026+4+536#4
Sat, Oct 3, 2026+4+369#3
Sun, Oct 4, 2026+7+314#3
Mon, Oct 5, 2026+4+640#4
Tue, Oct 6, 2026+2+135#7
Wed, Oct 7, 2026+5+930#4
Thu, Oct 8, 2026+14+725#1
Fri, Oct 9, 2026+9+712#2
Sat, Oct 10, 2026+5+112#6
Sun, Oct 11, 2026+6+17#2
Mon, Oct 12, 2026+7+1015#1
Tue, Oct 13, 2026+14+433#1
Wed, Oct 14, 2026+8+1035#2
Thu, Oct 15, 2026+7+516#2
Fri, Oct 16, 2026+16+326#1
Sat, Oct 17, 2026+34+510#1
Sun, Oct 18, 2026+14+837#1
Mon, Oct 19, 2026+18+758#1
Tue, Oct 20, 2026+19+767#2
Wed, Oct 21, 2026+6+453#7
Thu, Oct 22, 2026+14+950#1
Fri, Oct 23, 2026+15+361#1
Sat, Oct 24, 2026+12+652#1
Sun, Oct 25, 2026+5+299#1
Mon, Oct 26, 2026+14+398#2
Tue, Oct 27, 2026+5+1110#6
Wed, Oct 28, 2026+9+4190#2
Thu, Oct 29, 2026+10+5112#2
Fri, Oct 30, 2026+5+1076#4
Sat, Oct 31, 2026+4+561#5
Sun, Nov 1, 2026+3+776#6
Mon, Nov 2, 2026+11+4131#3
Tue, Nov 3, 2026+7+3142#3
Wed, Nov 4, 2026+10+6137#3
Thu, Nov 5, 2026+4+4128#4
Fri, Nov 6, 2026+5+3120#3
Sat, Nov 7, 2026+5+787#2
Sun, Nov 8, 2026+5+661#2
Mon, Nov 9, 2026+8+781#1
Tue, Nov 10, 2026+8+735#1
Wed, Nov 11, 2026+8+420#2
Thu, Nov 12, 2026+13+636#3
Fri, Nov 13, 2026+4+814#5
Sat, Nov 14, 2026+9+44#1
Sun, Nov 15, 2026+2+32#17
Mon, Nov 16, 2026+12+436#1
Tue, Nov 17, 2026+11+637#1
Wed, Nov 18, 2026+8+338#1
Thu, Nov 19, 2026+3+524#7
Fri, Nov 20, 2026+14+1046Not trending
Sat, Nov 21, 2026+7+75Not trending
Sun, Nov 22, 2026+4+10Not trending
Total+503+3053,028
  • 1#1 on the list
  • 7Rank that day
  • Not trending
2
  • GitHub trending history

    Where the repository ranked on GitHub Trending, one dot for each day it was on a list

    Aug 7 – Dec 12, 2025Best #2

    #1#5#10#15#20#25
    Top 10
    Sep 2025NovJan 2026MarMayJul
    The left and right arrow keys step from day to day; Home and End go to the first and the last

    Mentions and achievements

    Where people are talking about flashinfer-ai/flashinfer, and every badge it has earned
    1. Nov 151 post
      • I spend weekends(pure lie, two prompts in CC) So, its a rust compilation of Deepseek DeepInfer and Sglang more in thread

        Read full on X, posted by @justALEXWORTEGA

        @justALEXWORTEGA · x.com

    2. 1 month earlier
    3. Oct 112 posts
      • Four days, two DGX Station GB300s, five bugs. Every one looked like a model problem. One was in a GPU kernel; the others hid in the compiler, the inference engine, the OS and an overnight driver…

        Read full on X, posted by @SJRonanMD

        @SJRonanMD · x.com

      • Three bugs we hit on two DGX Stations, all now filed upstream: 1. FlashInfer b12x 4-bit MoE summed rows it never wrote: NaN 2. Same kernels: small scales made weights vanish, rows lost while cosine…

        Read full on X, posted by @SJRonanMD

        @SJRonanMD · x.com

    4. Oct 91 post
      • Recent discovery that NVIDIA reduces the performance for default FP8 MMA op of geforce cards. With same kernel but MX path, I can get almost +35% performance. I'm going to open another PR to SGL for…

        Read full on X, posted by @emre570_

        @emre570_ · x.com

    5. Oct 71 post
      • >look at a CAKE pr >300k LOC

        Read full on X, posted by @henrylhtsang

        @henrylhtsang · x.com

    6. 2 months earlier
    7. Aug 162 posts
      • Attention output is silently wrong in SGLang when FlashInfer is the backend

        Read full on Reddit

        r/LocalLLM

      • If you serve models with mla on sglang with --attention-backend flashinfer and you get radix cache hits above 8k your outputs are wrong right now. DeepSeek V2/V3/R1/V3.1/V3.2, bailing, glm4moe_lite,…

        Read full on X, posted by @advprop

        @advprop · x.com

    8. 10 days earlier
    9. Aug 61 post
      • 🍰 and another CAKE kernel merged into FlashInfer: SM100/SM103 tinygemm2, up to 1.79x faster on large shapes, ~18-23% geomean kernel-time reduction, e2e verified. translates to up to 7.6% end-to-end…

        Read full on X, posted by @ye_combinator

        @ye_combinator · x.com

    10. 12 days earlier
    11. Jul 251 post
      • // AI Infrastructure 7/10 Hetzner is building an LLM inference offering. If they bring their usual pricing to GPU serving, that's real pressure on the hyperscaler markups.

        Read full on X, posted by @addisonhuddy

        @addisonhuddy · x.com

    12. Jul 201 post
      • 14. a Rust inference engine is a good place to study the tradeoffs between portability, performance and implementation complexity. covers local inference, quantization and multiple accelerators…

        Read full on X, posted by @adidshaft

        @adidshaft · x.com

    You might also like

    Repositories close to flashinfer-ai/flashinfer
    FeaturedAdvertise to 180K+ monthly visitors
    It's a plan

    Open-source Linear alternative

    An issue tracker where AI agents take the work you assign them

    Busbar

    Control what AI can do before it acts

    OfinTech Desk

    An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

    Omnigraph

    Versioned graph database on object storage. Git-style workflows and multimodal retrieval

    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    Trina AX

    A self-hosted team AI workspace for company files, with per-person folder permissions

    Tencent/hpc-ops

    C++

    High Performance LLM Inference Operator Library

    1.2k155

    dangxingyu/megakernel-zoo

    Cuda

    Model-specific megakernel inference engines for LLM decoding, written by coding agents. OpenAI-compatible server, evaluation suite, and the kit to build your own.

    393

    vllm-project/vllm

    Python

    A high-throughput and memory-efficient inference and serving engine for LLMs

    97.3k25.1k

    local-inference-lab/vllm

    Python

    A high-throughput and memory-efficient inference and serving engine for LLMs

    4850

    Avarok-Cybersecurity/atlas

    Rust

    Pure Rust Inference Engine

    737112

    inferflow/inferflow

    C++

    Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

    25324

    hpcaitech/SwiftInfer

    Python

    Efficient AI Inference & Serving

    47031

    deepseek-ai/DeepGEMM

    Cuda

    DeepGEMM: clean and efficient BLAS kernel library on GPU

    9.2k1.4k

    cloudrift-ai/emmy

    Python

    Optimized GPU compiler for LLM inference. Choose from a list of optimized recipes or optimize your own model via kernel fusion, autotuning, and advanced scheduling. Run benchmarks across different GPU types and configurations, track results and share experiments with the community.

    12822