Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Busbar
Busbar
AxiomCode
AxiomCode
Bifrost
Bifrost

basecompute/baseRT

Fastest LLM inference runtime for Apple Silicon

#LLM inference
Visit GitHub
Rust
234
19
1 contributors
Apache License 2.0
website
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

AxiomCode

Give Al Agents a Deeper Understanding of Your Codebase with a Code Graph

Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

Momentum

How fast basecompute/baseRT is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Aug 20 – Oct 19, 2026

Stars +62 in 61 days

0510
7

Forks +6 in 61 days

01
1

Merged PRs 5 in 61 days

01
1

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Aug 20Aug 28Sep 5Sep 13Sep 21Sep 29Oct 7Oct 15
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Thu, Aug 20, 2026+7+10
Fri, Aug 21, 2026+2+00
Sat, Aug 22, 2026+1+00
Sun, Aug 23, 2026+3+10
Mon, Aug 24, 2026+1+00
Tue, Aug 25, 2026+4+00
Wed, Aug 26, 2026+3+00
Thu, Aug 27, 2026+3+00
Fri, Aug 28, 2026+3+00
Sat, Aug 29, 2026+1+00
Sun, Aug 30, 2026+3+00
Mon, Aug 31, 2026+0+00
Tue, Sep 1, 2026+0+00
Wed, Sep 2, 2026+0+00
Thu, Sep 3, 2026+0+00
Fri, Sep 4, 2026+0+00
Sat, Sep 5, 2026+0+00
Sun, Sep 6, 2026+1+00
Mon, Sep 7, 2026+3+10
Tue, Sep 8, 2026+1+00
Wed, Sep 9, 2026+0+01
Thu, Sep 10, 2026+0+00
Fri, Sep 11, 2026+2+01
Sat, Sep 12, 2026+1+00
Sun, Sep 13, 2026+0+00
Mon, Sep 14, 2026+0+00
Tue, Sep 15, 2026+3+00
Wed, Sep 16, 2026+1+00
Thu, Sep 17, 2026+0+01
Fri, Sep 18, 2026+2+01
Sat, Sep 19, 2026+1+00
Sun, Sep 20, 2026+1+00
Mon, Sep 21, 2026+1+00
Tue, Sep 22, 2026+1+00
Wed, Sep 23, 2026+0+00
Thu, Sep 24, 2026+0+00
Fri, Sep 25, 2026+0+00
Sat, Sep 26, 2026+0+00
Sun, Sep 27, 2026+0+00
Mon, Sep 28, 2026+1+10
Tue, Sep 29, 2026+0+00
Wed, Sep 30, 2026+2+00
Thu, Oct 1, 2026+0+00
Fri, Oct 2, 2026+0+00
Sat, Oct 3, 2026+0+00
Sun, Oct 4, 2026+1+00
Mon, Oct 5, 2026+1+00
Tue, Oct 6, 2026+0+00
Wed, Oct 7, 2026+1+00
Thu, Oct 8, 2026+1+01
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+1+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+0+00
Tue, Oct 13, 2026+1+10
Wed, Oct 14, 2026+1+00
Thu, Oct 15, 2026+1+00
Fri, Oct 16, 2026+0+10
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+0+00
Mon, Oct 19, 2026+2+00
Total+62+65
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Jul 231 post

    • These results push the performance ceiling of on-device LLM inference on Apple Silicon markedly higher and demonstrate that exploiting the M5's tensor cores translates into substantial, measurable…

      Read full on X, posted by @Underfox3

      @Underfox3 · x.com

  2. Jul 201 post

    • BaseRT is the fastest local LLM runtime on Apple Silicon!

      Read full on Reddit

      r/LocalLLM

  3. 18 days earlier
  4. Jul 21 post

    • The results across a suite of open-source LLMs show that BaseRT achieves higher throughput than any previously reported runtime on Apple Silicon, establishing a new performance baseline for on-device…

      Read full on X, posted by @Underfox3

      @Underfox3 · x.com

  5. Jul 11 post

    • We’ve built the fastest inference runtime for LLMs on Apple Silicon, faster than MLX and llama.cpp. BaseRT is up to 35% faster than Apple's MLX on token generation (decode) for small models, and 78%…

      Read full on X, posted by @basecmpt

      @basecmpt · x.com

You might also like

Repositories close to basecompute/baseRT
FeaturedAdvertise to 180K+ monthly visitors
AxiomCode

Give Al Agents a Deeper Understanding of Your Codebase with a Code Graph

Busbar

Control what AI can do before it acts

Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

waybarrios/vllm-mlx

Python

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

1.6k253

SharpAI/SwiftLM

Swift

⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

78459

jundot/omlx

Python

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

22.9k2.3k

incoai/splash

C++

A local inference engine for Apple silicon, built around the model.

1.5k139

ashhart/TensorFold

Zig

LLM Inference Engine for Metal and CUDA.

1.4k255

lablup/mlxcel

Rust

High-performance LLM, VLM, embedding, reranking, and audio inference for Apple Silicon and NVIDIA CUDA systems.

47460

lithos-ai/lithos-metal

Python

Lithos Metal: high-performance LLM inference kernels and serving for Apple silicon.

29724

perplexityai/pplx-garden

Rust

Perplexity open source garden for inference technology

944120

ml-explore/mlx-lm

Python

Run LLMs with MLX

7.4k1.2k