Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost

mlc-ai/mlc-llm

Universal LLM Deployment Engine with ML Compilation

#LLM inference
Visit GitHub
Python
23.3k
2.3k
164 contributors
Apache License 2.0
website
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast mlc-ai/mlc-llm is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 6 – Nov 5, 2026

Stars +177 in 61 days

051015
13

Forks +206 in 61 days

02040
38

Merged PRs 17 in 61 days

0510
7

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 6Sep 14Sep 22Sep 30Oct 8Oct 16Oct 24Nov 1
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sun, Sep 6, 2026+2+10
Mon, Sep 7, 2026+2+10
Tue, Sep 8, 2026+0+00
Wed, Sep 9, 2026+2+00
Thu, Sep 10, 2026+4+10
Fri, Sep 11, 2026+5+10
Sat, Sep 12, 2026+1+20
Sun, Sep 13, 2026+4+20
Mon, Sep 14, 2026+2+10
Tue, Sep 15, 2026+5+10
Wed, Sep 16, 2026+4+00
Thu, Sep 17, 2026+1+00
Fri, Sep 18, 2026+2+10
Sat, Sep 19, 2026+1+30
Sun, Sep 20, 2026+2+20
Mon, Sep 21, 2026+6+00
Tue, Sep 22, 2026+5+00
Wed, Sep 23, 2026+2+00
Thu, Sep 24, 2026+4+00
Fri, Sep 25, 2026+6+20
Sat, Sep 26, 2026+1+20
Sun, Sep 27, 2026+4+20
Mon, Sep 28, 2026+0+10
Tue, Sep 29, 2026+3+17
Wed, Sep 30, 2026+2+14
Thu, Oct 1, 2026+0+01
Fri, Oct 2, 2026+0+00
Sat, Oct 3, 2026+2+30
Sun, Oct 4, 2026+4+11
Mon, Oct 5, 2026+3+00
Tue, Oct 6, 2026+1+11
Wed, Oct 7, 2026+1+10
Thu, Oct 8, 2026+2+00
Fri, Oct 9, 2026+13+100
Sat, Oct 10, 2026+3+30
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+2+00
Tue, Oct 13, 2026+11+80
Wed, Oct 14, 2026+8+50
Thu, Oct 15, 2026+2+60
Fri, Oct 16, 2026+1+190
Sat, Oct 17, 2026+0+380
Sun, Oct 18, 2026+4+380
Mon, Oct 19, 2026+5+360
Tue, Oct 20, 2026+2+40
Wed, Oct 21, 2026+4+00
Thu, Oct 22, 2026+0+20
Fri, Oct 23, 2026+5+00
Sat, Oct 24, 2026+3+10
Sun, Oct 25, 2026+0+00
Mon, Oct 26, 2026+4+20
Tue, Oct 27, 2026+6+00
Wed, Oct 28, 2026+2+10
Thu, Oct 29, 2026+1+00
Fri, Oct 30, 2026+0+13
Sat, Oct 31, 2026+4+00
Sun, Nov 1, 2026+1+10
Mon, Nov 2, 2026+7+00
Tue, Nov 3, 2026+6+00
Wed, Nov 4, 2026+0+00
Thu, Nov 5, 2026+0+00
Total+177+20617
  • 1#1 on the list
  • 7Rank that day
  • Not trending
2

    • GitHub trending history

    Where the repository ranked on GitHub Trending, one dot for each day it was on a list

    Aug 3, 2024Best #9

    #1#5#10#15#20#25
    Top 10
    Jan 2024AprJulOctJan 2025Apr
    The left and right arrow keys step from day to day; Home and End go to the first and the last

    Mentions and achievements

    Where people are talking about mlc-ai/mlc-llm, and every badge it has earned
    1. Oct 102 posts

      • MLC LLM：大模型部署走"编译一次，到处运行"路线。基于 Apache TVM 编译，一份权重覆盖 AMD / NVIDIA / Apple / Intel GPU、WebGPU、手机，提供 OpenAI-compatible API。 不像 llama.cpp 手写 kernel，它靠编译器自动调优。评价：学院派打法，设备杂可试。

        Read full on X, posted by @cywcycw

        @cywcycw · x.com

      • MLC LLM：大模型部署走"编译一次，到处运行"路线。基于 Apache TVM 编译，一份权重覆盖 AMD / NVIDIA / Apple / Intel GPU、WebGPU、手机，提供 OpenAI-compatible API。 不像 llama.cpp 手写 kernel，它靠编译器自动调优。评价：学院派打法，设备杂可试。

        Read full on X, posted by @cywcycw

        @cywcycw · x.com

    2. 22 days earlier
    3. Sep 182 posts

      • A practical comparison of llama.cpp, TensorSharp, Ollama, MLX-LM, MLC LLM, vLLM, SGLang, and other open-source inference stacks

        Read full on Reddit

        r/LocalLLaMA

      • Comparing TensorSharp, llama.cpp, vLLM, SGLang, and open-source agent runtimes from a .NET perspective

        Read full on Reddit

        r/dotnet

    4. 3 months earlier
    5. Jun 281 post

      • 🚀 MLC LLM simplifies deploying large language models across platforms. See link below 👇

        Read full on X, posted by @RepoGems

        @RepoGems · x.com

    6. 26 days earlier
    7. Jun 21 post

      • 9/ llm.c by Karpathy (29.7k ⭐) LLM training and inference in raw C/CUDA. Minimalist and educational. The repo to read if you want to actually understand what's happening under the hood.

        Read full on X, posted by @itsharmanjot

        @itsharmanjot · x.com

    You might also like

    Repositories close to mlc-ai/mlc-llm
    FeaturedAdvertise to 180K+ monthly visitors
    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    InternLM/lmdeploy

    Python

    LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

    8.1k822

    local-inference-lab/vllm

    Python

    A high-throughput and memory-efficient inference and serving engine for LLMs

    4446

    vllm-project/vllm

    Python

    A high-throughput and memory-efficient inference and serving engine for LLMs

    96.3k24.2k

    mlc-ai/web-llm

    TypeScript

    High-performance In-browser LLM Inference Engine

    19.4k1.6k

    bentoml/OpenLLM

    Python

    Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

    12.6k1k

    scaleapi/llm-engine

    Python

    Scale LLM Engine public repository

    84099

    xorbitsai/inference

    Python

    Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

    9.6k935

    Tiiny-AI/PowerInfer

    C++

    High-speed Large Language Model Serving for Local Deployment

    9.9k657

    inferflow/inferflow

    C++

    Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

    25324