Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost

NVIDIA/TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

#LLM inference
Visit GitHub
Python
15k
2.9k
491 contributors
Custom license
website
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast NVIDIA/TensorRT-LLM is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 5 – Nov 4, 2026

Stars +458 in 61 days

0102030
25

Forks +203 in 61 days

0510
10

Merged PRs 1,663 in 61 days

050100
65

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 5Sep 13Sep 21Sep 29Oct 7Oct 15Oct 23Oct 31
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sat, Sep 5, 2026+5+29
Sun, Sep 6, 2026+5+19
Mon, Sep 7, 2026+6+227
Tue, Sep 8, 2026+9+341
Wed, Sep 9, 2026+4+435
Thu, Sep 10, 2026+13+433
Fri, Sep 11, 2026+6+337
Sat, Sep 12, 2026+10+316
Sun, Sep 13, 2026+6+35
Mon, Sep 14, 2026+10+333
Tue, Sep 15, 2026+4+334
Wed, Sep 16, 2026+4+347
Thu, Sep 17, 2026+10+645
Fri, Sep 18, 2026+18+734
Sat, Sep 19, 2026+13+217
Sun, Sep 20, 2026+8+212
Mon, Sep 21, 2026+9+340
Tue, Sep 22, 2026+10+345
Wed, Sep 23, 2026+6+226
Thu, Sep 24, 2026+7+19
Fri, Sep 25, 2026+2+30
Sat, Sep 26, 2026+6+13
Sun, Sep 27, 2026+3+25
Mon, Sep 28, 2026+9+317
Tue, Sep 29, 2026+14+120
Wed, Sep 30, 2026+5+424
Thu, Oct 1, 2026+5+615
Fri, Oct 2, 2026+1+221
Sat, Oct 3, 2026+5+34
Sun, Oct 4, 2026+0+13
Mon, Oct 5, 2026+2+311
Tue, Oct 6, 2026+5+226
Wed, Oct 7, 2026+8+122
Thu, Oct 8, 2026+0+430
Fri, Oct 9, 2026+5+436
Sat, Oct 10, 2026+7+110
Sun, Oct 11, 2026+6+23
Mon, Oct 12, 2026+8+437
Tue, Oct 13, 2026+6+436
Wed, Oct 14, 2026+7+256
Thu, Oct 15, 2026+9+443
Fri, Oct 16, 2026+11+548
Sat, Oct 17, 2026+8+512
Sun, Oct 18, 2026+7+23
Mon, Oct 19, 2026+11+736
Tue, Oct 20, 2026+21+347
Wed, Oct 21, 2026+25+543
Thu, Oct 22, 2026+14+543
Fri, Oct 23, 2026+11+1065
Sat, Oct 24, 2026+7+118
Sun, Oct 25, 2026+6+57
Mon, Oct 26, 2026+11+245
Tue, Oct 27, 2026+6+453
Wed, Oct 28, 2026+5+748
Thu, Oct 29, 2026+7+647
Fri, Oct 30, 2026+5+650
Sat, Oct 31, 2026+4+112
Sun, Nov 1, 2026+4+26
Mon, Nov 2, 2026+6+443
Tue, Nov 3, 2026+9+556
Wed, Nov 4, 2026+4+15
Total+458+2031,663
  • 1#1 on the list
  • 7Rank that day
  • Not trending
1

    • GitHub trending history

    Where the repository ranked on GitHub Trending, one dot for each day it was on a list

    Oct 22, 2023 – Mar 25, 2025#1 on 1 day

    #1#5#10#15#20#25
    Top 10
    Nov 2023MayNovMayNovMay
    The left and right arrow keys step from day to day; Home and End go to the first and the last

    Mentions and achievements

    Where people are talking about NVIDIA/TensorRT-LLM, and every badge it has earned
    1. Nov 21 post

      • 2. SGLang → Designed for fast and efficient LLM serving. → Uses RadixAttention and prefix caching to reuse shared context. → Particularly useful for agentic workflows, long prompts, and structured…

        Read full on X, posted by @goyalshaliniuk

        @goyalshaliniuk · x.com

    2. 2 months earlier
    3. Sep 182 posts

      • A practical comparison of llama.cpp, TensorSharp, Ollama, MLX-LM, MLC LLM, vLLM, SGLang, and other open-source inference stacks

        Read full on Reddit

        r/LocalLLaMA

      • Comparing TensorSharp, llama.cpp, vLLM, SGLang, and open-source agent runtimes from a .NET perspective

        Read full on Reddit

        r/dotnet

    4. 7 days earlier
    5. Sep 111 post

      • SGLang Moves from the small implementation to production serving for language and multimodal models across single GPUs and distributed clusters.

        Read full on X, posted by @agenticgirl

        @agenticgirl · x.com

    6. 8 days earlier
    7. Sep 31 post

      • Glad to partner with the vLLM community to bring Skip Softmax attention, our MLSys 26 best paper (BLASST, into MiniMax H3 serving! It is now a built-in option of vLLM-Omni's TRTLLM attention backend…

        Read full on X, posted by @bobboli0202

        @bobboli0202 · x.com

    8. 2 months earlier
    9. Jul 71 post

      • EAGLE 3.1 has been merged into @nvidia TensorRT-LLM. The integration brings EAGLE's latest speculative decoding architecture to one of the most widely used inference frameworks for NVIDIA GPUs. EAGLE…

        Read full on X, posted by @EagleCorp

        @EagleCorp · x.com

    10. Jul 21 post

      • As an AI Infrastructure Engineer Please learn: - GPU architecture, VRAM fundamentals, CUDA & memory hierarchy - Quantization (INT8/FP8/4-bit), batching & continuous batching - vLLM, TensorRT-LLM,…

        Read full on X, posted by @Alacritic_Super

        @Alacritic_Super · x.com

    11. 1 month earlier
    12. Jun 21 post

      • 12/ whisper.cpp (49.1k ⭐) High-performance port of OpenAI's Whisper in C/C++. Real-time audio transcription on your laptop with no API calls.

        Read full on X, posted by @itsharmanjot

        @itsharmanjot · x.com

    You might also like

    Repositories close to NVIDIA/TensorRT-LLM
    FeaturedAdvertise to 180K+ monthly visitors
    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    microsoft/onnxruntime-genai

    C++

    Generative AI with ONNX Runtime

    1.1k378

    huggingface/optimum-nvidia

    Python
    1k105

    harleyszhang/rapid_llm

    Python

    RapidLLM is an LLM inference framework with continuous batching, tensor and data parallelism, quantized weights, and with pluggable Triton/CUDA kernels.

    19633

    flashinfer-ai/flashinfer

    Cuda

    FlashInfer: Kernel Library for LLM Serving

    6.9k1.7k

    ModelTC/LightLLM

    Python

    LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

    4.4k386

    vllm-project/vllm

    Python

    A high-throughput and memory-efficient inference and serving engine for LLMs

    96.3k24.2k

    zhihu/ZhiLight

    C++

    A highly optimized LLM inference acceleration engine for Llama and its variants.

    906108

    iamwavecut/ninfer-all

    C++

    One line of NInfer for the Blackwell, Ada Lovelace, Ampere, Turing and Volta NVIDIA GPUs, consolidated from the forks that carry it: GGUF block formats, ternary Bonsai 2, device route profiles, MTP and DFlash2.

    18738

    naklecha/simple-llm

    Python

    ~1300 line, minimal, extensible LLM inference engine built from scratch.

    49238