Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Omnigraph
Omnigraph
Websitebench
Websitebench
Bifrost
Bifrost
Busbar
Busbar

jundot/omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

#LLM inference
Visit GitHub
Python
23.6k
2.4k
139 contributors
Apache License 2.0
website
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Websitebench

Can AI agents reverse-engineer real websites?

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Busbar

Control what AI can do before it acts

Momentum

How fast jundot/omlx is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 13 – Nov 12, 2026

Stars +1,918 in 61 days

050100
69

Forks +449 in 61 days

0204060
57

Merged PRs 607 in 61 days

02040
33

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 13Sep 21Sep 29Oct 7Oct 15Oct 23Oct 31Nov 8
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sun, Sep 13, 2026+30+85
Mon, Sep 14, 2026+41+610
Tue, Sep 15, 2026+38+312
Wed, Sep 16, 2026+41+210
Thu, Sep 17, 2026+36+410
Fri, Sep 18, 2026+40+85
Sat, Sep 19, 2026+42+60
Sun, Sep 20, 2026+35+20
Mon, Sep 21, 2026+47+317
Tue, Sep 22, 2026+69+123
Wed, Sep 23, 2026+69+715
Thu, Sep 24, 2026+45+614
Fri, Sep 25, 2026+54+50
Sat, Sep 26, 2026+29+28
Sun, Sep 27, 2026+32+40
Mon, Sep 28, 2026+32+526
Tue, Sep 29, 2026+31+518
Wed, Sep 30, 2026+32+633
Thu, Oct 1, 2026+33+80
Fri, Oct 2, 2026+31+526
Sat, Oct 3, 2026+25+21
Sun, Oct 4, 2026+21+30
Mon, Oct 5, 2026+31+531
Tue, Oct 6, 2026+41+617
Wed, Oct 7, 2026+30+77
Thu, Oct 8, 2026+27+68
Fri, Oct 9, 2026+22+628
Sat, Oct 10, 2026+28+61
Sun, Oct 11, 2026+22+65
Mon, Oct 12, 2026+22+516
Tue, Oct 13, 2026+34+66
Wed, Oct 14, 2026+35+1010
Thu, Oct 15, 2026+38+1329
Fri, Oct 16, 2026+25+273
Sat, Oct 17, 2026+19+579
Sun, Oct 18, 2026+23+360
Mon, Oct 19, 2026+28+3812
Tue, Oct 20, 2026+28+612
Wed, Oct 21, 2026+10+521
Thu, Oct 22, 2026+22+31
Fri, Oct 23, 2026+18+56
Sat, Oct 24, 2026+17+630
Sun, Oct 25, 2026+16+50
Mon, Oct 26, 2026+23+322
Tue, Oct 27, 2026+34+512
Wed, Oct 28, 2026+24+31
Thu, Oct 29, 2026+36+410
Fri, Oct 30, 2026+41+73
Sat, Oct 31, 2026+27+419
Sun, Nov 1, 2026+34+40
Mon, Nov 2, 2026+25+112
Tue, Nov 3, 2026+42+37
Wed, Nov 4, 2026+35+416
Thu, Nov 5, 2026+18+60
Fri, Nov 6, 2026+33+40
Sat, Nov 7, 2026+23+30
Sun, Nov 8, 2026+23+40
Mon, Nov 9, 2026+20+50
Tue, Nov 10, 2026+26+713
Wed, Nov 11, 2026+23+527
Thu, Nov 12, 2026+42+10
Total+1,918+449607
  • 1#1 on the list
  • 7Rank that day
  • Not trending
4

    • GitHub trending history

    Where the repository ranked on GitHub Trending, one dot for each day it was on a list

    May 10 – Aug 19, 2026Best #6

    #1#5#10#15#20#25
    Top 10
    May 2026JunJulAugSep
    The left and right arrow keys step from day to day; Home and End go to the first and the last

    Mentions and achievements

    Where people are talking about jundot/omlx, and every badge it has earned
    1. Nov 71 post

      • OMLX: Use a second Mac to speed up local LLM prefill 2.9x

        Read full on Hacker News

        Hacker News

    2. Nov 11 post

      • oMLX 是个什么项目？ 看起来比Grok Bot还吊的样子

        Read full on X, posted by @BlockInsight214

        @BlockInsight214 · x.com

    3. Oct 291 post

      • You can now use oMLX in LM Studio! Download the new engine and use it with MLX models you already have. Excited to work with with @jundotkim and @huggingface to make this happen! 👾🐧🚀

        Read full on X, posted by @lmstudio

        @lmstudio · x.com

    4. 13 days earlier
    5. Oct 161 post

      • penalty box and silently rejects all its GPU work. oMLX notices, exits and gets restarted. Repeat forever an ever The numbers from my own logs: • 1 model: ~1,700 calls/day, 0 GPU hangs, for weeks • 2…

        Read full on X, posted by @euzharkov

        @euzharkov · x.com

    6. Oct 111 post

      • oMLX v0.7 Splash PR benchmark on M3U 512 Studio & M4M 128 Studio

        Read full on Reddit

        r/oMLX

    7. Oct 101 post

      • oMLX 0.7.1dev1 Improved oQ Quantization - Qwen Benchmarks

        Read full on Reddit

        r/oMLX

    8. Oct 91 post

      • Anyone knows how to replicate the Penguin Decision Run demo in 0.7.1.dev1?

        Read full on Reddit

        r/oMLX

    9. 9 days earlier
    10. Sep 301 post

      • oMLX 0.70 Stable Release

        Read full on Reddit

        r/oMLX

    11. Sep 251 post

      • Finally got Claude Desktop talking to my local models on my Mac. No more proxy hell.

        Read full on Reddit

        r/oMLX

    12. Sep 241 post

      • 0.7.0rc1 is out

        Read full on Reddit

        r/oMLX

    You might also like

    Repositories close to jundot/omlx
    FeaturedAdvertise to 180K+ monthly visitors
    Busbar

    Control what AI can do before it acts

    Websitebench

    Can AI agents reverse-engineer real websites?

    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    Omnigraph

    Versioned graph database on object storage. Git-style workflows and multimodal retrieval

    waybarrios/vllm-mlx

    Python

    High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

    1.7k264

    magicnight/Mac-MLX

    Swift

    macMLX brings local LLM inference to Apple Silicon with a first-class native macOS experience. No cloud, no telemetry, no Electron — just your Mac running models at full speed.

    856

    madroidmaq/mlx-omni-server

    Python

    MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveraging the power of local ML inference.

    74693

    zouyee/dmlx

    Zig

    Big models. Small Macs. Zero excuses.

    614

    SharpAI/SwiftLM

    Swift

    ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

    79663

    samuelfaj/lightning-mlx

    Python

    🔥 The fastest local AI engine for Apple Silicon. Optimised for agentic use.

    9912

    SRSWTI/bodega-inference-engine

    Python

    fastest runtime for apple silicon.

    913

    panbanda/higgs

    Rust

    A rust mlx server, ui, and model router for fast, dependency free inference on apple architecture

    346

    basecompute/baseRT

    Rust

    Fastest LLM inference runtime for Apple Silicon

    25021