Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

OfinTech Desk
OfinTech Desk
It's a plan
It's a plan
Omnigraph
Omnigraph
Bifrost
Bifrost
Busbar
Busbar

magnitudedev/magnitude

Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.

#LLM inference
Visit GitHub
Rust
7.9k
592
2 contributors
Apache License 2.0
website
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Busbar

Control what AI can do before it acts

Momentum

How fast magnitudedev/magnitude is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 18 – Nov 17, 2026

Stars +3,257 in 61 days

0200400600
442

Forks +235 in 61 days

01020
17

Merged PRs 45 in 61 days

0246
6

Trendshift Trendingwhere the repository ranked each day it made the top 25

Top 25 overall

19

Top 25 in Rust

1423
Sep 18Sep 26Oct 4Oct 12Oct 20Oct 28Nov 5Nov 13
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRsAll languagesRust
Fri, Sep 18, 2026+18+34Not trendingNot trending
Sat, Sep 19, 2026+65+91Not trendingNot trending
Sun, Sep 20, 2026+22+30Not trendingNot trending
Mon, Sep 21, 2026+44+01Not trendingNot trending
Tue, Sep 22, 2026+80+21Not trendingNot trending
Wed, Sep 23, 2026+91+52Not trendingNot trending
Thu, Sep 24, 2026+89+40Not trendingNot trending
Fri, Sep 25, 2026+79+00Not trendingNot trending
Sat, Sep 26, 2026+66+20Not trendingNot trending
Sun, Sep 27, 2026+94+21Not trendingNot trending
Mon, Sep 28, 2026+129+61Not trendingNot trending
Tue, Sep 29, 2026+79+70Not trendingNot trending
Wed, Sep 30, 2026+219+76Not trendingNot trending
Thu, Oct 1, 2026+442+131#19Not trending
Fri, Oct 2, 2026+145+171Not trendingNot trending
Sat, Oct 3, 2026+47+21Not trendingNot trending
Sun, Oct 4, 2026+38+41Not trendingNot trending
Mon, Oct 5, 2026+70+91Not trendingNot trending
Tue, Oct 6, 2026+30+30Not trendingNot trending
Wed, Oct 7, 2026+24+20Not trendingNot trending
Thu, Oct 8, 2026+13+20Not trendingNot trending
Fri, Oct 9, 2026+94+80Not trendingNot trending
Sat, Oct 10, 2026+33+31Not trendingNot trending
Sun, Oct 11, 2026+25+32Not trendingNot trending
Mon, Oct 12, 2026+34+22Not trendingNot trending
Tue, Oct 13, 2026+27+30Not trendingNot trending
Wed, Oct 14, 2026+15+12Not trendingNot trending
Thu, Oct 15, 2026+114+40Not trendingNot trending
Fri, Oct 16, 2026+170+110Not trending#14
Sat, Oct 17, 2026+48+50Not trendingNot trending
Sun, Oct 18, 2026+95+80Not trendingNot trending
Mon, Oct 19, 2026+45+30Not trendingNot trending
Tue, Oct 20, 2026+31+91Not trendingNot trending
Wed, Oct 21, 2026+35+50Not trendingNot trending
Thu, Oct 22, 2026+20+31Not trendingNot trending
Fri, Oct 23, 2026+18+20Not trendingNot trending
Sat, Oct 24, 2026+14+20Not trendingNot trending
Sun, Oct 25, 2026+14+30Not trendingNot trending
Mon, Oct 26, 2026+9+11Not trendingNot trending
Tue, Oct 27, 2026+12+11Not trendingNot trending
Wed, Oct 28, 2026+96+103Not trendingNot trending
Thu, Oct 29, 2026+108+121Not trending#23
Fri, Oct 30, 2026+55+81Not trendingNot trending
Sat, Oct 31, 2026+25+40Not trendingNot trending
Sun, Nov 1, 2026+17+31Not trendingNot trending
Mon, Nov 2, 2026+21+20Not trendingNot trending
Tue, Nov 3, 2026+8+01Not trendingNot trending
Wed, Nov 4, 2026+16+00Not trendingNot trending
Thu, Nov 5, 2026+9+10Not trendingNot trending
Fri, Nov 6, 2026+14+00Not trendingNot trending
Sat, Nov 7, 2026+14+50Not trendingNot trending
Sun, Nov 8, 2026+13+21Not trendingNot trending
Mon, Nov 9, 2026+12+11Not trendingNot trending
Tue, Nov 10, 2026+5+10Not trendingNot trending
Wed, Nov 11, 2026+17+40Not trendingNot trending
Thu, Nov 12, 2026+4+10Not trendingNot trending
Fri, Nov 13, 2026+4+00Not trendingNot trending
Sat, Nov 14, 2026+11+21Not trendingNot trending
Sun, Nov 15, 2026+42+02Not trendingNot trending
Mon, Nov 16, 2026+23+00Not trendingNot trending
Tue, Nov 17, 2026+6+00Not trendingNot trending
Total+3,257+23545
  • 1#1 on the list
  • 7Rank that day
  • Not trending
1
  • GitHub trending history

    Where the repository ranked on GitHub Trending, one dot for each day it was on a list

    Sep 3 – Sep 6, 2026Best #9

    #1#5#10#15#20#25
    Top 10
    Jul 2025SepNovJan 2026MarMayJulSep
    The left and right arrow keys step from day to day; Home and End go to the first and the last

    Mentions and achievements

    Where people are talking about magnitudedev/magnitude, and every badge it has earned
    1. Oct 281 post
      • 本地跑模型还在用默认引擎?试试会自己调 kernel 的。 Magnitude:开源推理引擎,按你的硬件编译调优每个模型的 kernel,自称比 Ollama 快约 2 倍;Apple Silicon / NVIDIA / AMD / CPU 都行。 常在本机跑模型的,先点开看看。 #开源工具 #本地推理 #LLM

        Read full on X, posted by @dali275900

        @dali275900 · x.com

    2. 11 days earlier
    3. Oct 171 post
      • 本地跑大模型,别再默认塞个 Ollama 就完事了。这个开源引擎冲着"本机 Agent 推理"来,官方数字里解码能到 Ollama 两倍上下。 项目叫 Magnitude,YC S25 团队做的,Apache 2.0 协议,Rust 写的,GitHub 已经约 7000 星。桌面端 + 本地 HTTP 接口,默认挂在 127.0.0.1:10100,OpenAI / Anthropic…

        Read full on X, posted by @sanyanzhumo

        @sanyanzhumo · x.com

    4. Oct 162 posts
      • Qwen3.6 35B-A3B on one DGX Spark: Magnitude copies text 2.17x faster than Ollama, but writes a new story at 0.79x Ollama's speed. @tomgreenwald launched Magnitude on Oct 15 as "over 2x faster than…

        Read full on X, posted by @niklaslenz_ai

        @niklaslenz_ai · x.com

      • 好家伙,号称本地跑模型比 Ollama 快一倍的开源工具,我一测,写起文字来居然还没 Ollama 快!🤔 我在 M2 Max 上让 Magnitude 和 Ollama 跑同一个 Qwen3.5 4B,写 Python 代码时每秒出的 token 是 139 对 85。可换成用中文解释 Git 概念,就成了 67 对 84。 查了下,原来 Magnitude…

        Read full on X, posted by @yupi996

        @yupi996 · x.com

    5. 11 days earlier
    6. Oct 51 post
      • 终于有人把“本地跑 Coding Agent”的真实痛点给治了: 平时本地接 Claude Code、Cline 跑代码,最烦两件事: 1. 上下文一长,llama.cpp 慢得像便秘; 2. 跑完一个任务显存还不放,电脑直接卡死。 Magnitude 核心就干了两件事: 一是在你芯片上现场 Tuning 算子拉满速度; 二是把上下文显存改成动态释放,多轮对话共享前缀缓存。 以前 16G/32G…

        Read full on X, posted by @mylifcc

        @mylifcc · x.com

    7. Oct 11 post
      • Magnitude’s local inference engine shares prefix caches across sessions and frees per-session memory when agents stop. The human is still a concurrent workload.

        Read full on X, posted by @wik_plus

        @wik_plus · x.com

    8. Sep 304 posts
      • Open source inference engine (like LM Studio or Unsloth Desktop) that optimizes itself for your exact hardware. Compiles and tunes its kernels on your device, so open models run up to 2x faster than…

        Read full on Reddit

        r/LocalLLaMA

      • What TLA+ can and can't check (

        Read full on X, posted by @betterhn50

        @betterhn50 · x.com

      • Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents

        Read full on Reddit

        r/hackernews

      • Commit Description as a Thinking Tool (

        Read full on X, posted by @betterhn20

        @betterhn20 · x.com

    You might also like

    Repositories close to magnitudedev/magnitude
    FeaturedAdvertise to 180K+ monthly visitors
    Busbar

    Control what AI can do before it acts

    OfinTech Desk

    An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    It's a plan

    Open-source Linear alternative

    An issue tracker where AI agents take the work you assign them

    Omnigraph

    Versioned graph database on object storage. Git-style workflows and multimodal retrieval

    recursive-oss/rec

    Python

    Our lightning-fast inference engine.

    28650

    SRSWTI/bodega-inference-engine

    Python

    fastest runtime for apple silicon.

    913

    samuelfaj/lightning-mlx

    Python

    🔥 The fastest local AI engine for Apple Silicon. Optimised for agentic use.

    9912

    Veloresearch/kinetic

    Rust

    The open engine for running AI on your own computer. Fast, exact, open source.

    907

    Incept5-AI/inferd

    Python

    Native Apple Silicon inference engine for many AI agents at once: C++/Metal, agent-contexts API, 8-bit paged KV, SSD tier (Qwen3.8)

    353

    basecompute/baseRT

    Rust

    Fastest LLM inference runtime for Apple Silicon

    25021

    jitllm/jitllm

    Go

    Smart inference engine that adapts to your hardware to run models faster, even when they don’t fit in memory

    586

    Generated-Computers/Locals

    Python

    Run many AI agents at once on your Mac, up to 3x faster.

    65143

    nace-ai/kapitsa

    C++

    Blazing fast Apple Silicon inference engine optimized for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai

    814116