Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Busbar
Busbar
Bifrost
Bifrost
AxiomCode
AxiomCode

NeelM0906/Mference

Swift + Metal MoE inference for Apple Silicon: Qwen 3.6 35B at 23.5–29.3 tok/s decode with 2.20× faster long-prompt prefill on a 24 GB M5; Gemma 4 26B in ~2 GB, DeepSeek-V4-Flash 284B, Inkling-Small 276B, native Mac app, CLI, and OpenAI-compatible server.

#LLM inference
Visit GitHub
Swift
122
16
2 contributors
Custom license
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

AxiomCode

Give Al Agents a Deeper Understanding of Your Codebase with a Code Graph

Momentum

How fast NeelM0906/Mference is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Aug 23 – Oct 21, 2026

Stars +27 in 60 days

024
4

Forks +8 in 60 days

012
2

Merged PRs 20 in 60 days

024
4

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Aug 23Aug 31Sep 8Sep 16Sep 24Oct 2Oct 10Oct 18
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sun, Aug 23, 2026+2+00
Mon, Aug 24, 2026+1+00
Tue, Aug 25, 2026+2+20
Wed, Aug 26, 2026+1+12
Thu, Aug 27, 2026+1+00
Fri, Aug 28, 2026+0+01
Sat, Aug 29, 2026+0+00
Sun, Aug 30, 2026+0+00
Mon, Aug 31, 2026+4+00
Tue, Sep 1, 2026+0+20
Wed, Sep 2, 2026+0+01
Thu, Sep 3, 2026+0+00
Fri, Sep 4, 2026+0+00
Sat, Sep 5, 2026+0+00
Sun, Sep 6, 2026+1+00
Mon, Sep 7, 2026+0+00
Tue, Sep 8, 2026+0+00
Wed, Sep 9, 2026+0+00
Thu, Sep 10, 2026+1+04
Fri, Sep 11, 2026+0+02
Sat, Sep 12, 2026+0+00
Sun, Sep 13, 2026+2+00
Mon, Sep 14, 2026+0+01
Tue, Sep 15, 2026+1+00
Wed, Sep 16, 2026+2+01
Thu, Sep 17, 2026+0+00
Fri, Sep 18, 2026+1+04
Sat, Sep 19, 2026+0+00
Sun, Sep 20, 2026+2+11
Mon, Sep 21, 2026+0+02
Tue, Sep 22, 2026+0+00
Wed, Sep 23, 2026+0+10
Thu, Sep 24, 2026+0+00
Fri, Sep 25, 2026+1+01
Sat, Sep 26, 2026+0+00
Sun, Sep 27, 2026+0+10
Mon, Sep 28, 2026+0+00
Tue, Sep 29, 2026+0+00
Wed, Sep 30, 2026+1+00
Thu, Oct 1, 2026+0+00
Fri, Oct 2, 2026+0+00
Sat, Oct 3, 2026+0+00
Sun, Oct 4, 2026+0+00
Mon, Oct 5, 2026+2+00
Tue, Oct 6, 2026+1+00
Wed, Oct 7, 2026+0+00
Thu, Oct 8, 2026+1+00
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+0+00
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+0+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+0+00
Mon, Oct 19, 2026+0+00
Tue, Oct 20, 2026+0+00
Wed, Oct 21, 2026+0+00
Total+27+820
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Mentions and achievements

Where people are talking about NeelM0906/Mference, and every badge it has earned
  1. Aug 51 post

    • Inkling-Small 276B-A12B at ~2.9 tok/s on <10gb memory

      Read full on Reddit

      r/LocalLLaMA

  2. Aug 21 post

    • DeepSeek-V4-Flash 284B on 5.3GB of memory

      Read full on Reddit

      r/LocalLLaMA

You might also like

Repositories close to NeelM0906/Mference
FeaturedAdvertise to 180K+ monthly visitors
AxiomCode

Give Al Agents a Deeper Understanding of Your Codebase with a Code Graph

Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

Busbar

Control what AI can do before it acts

danveloper/flash-moe

Objective-C

Running a big model on a small laptop

4.3k513

yanun0323/Whallm

Python

DeepSeek-V4-Flash-0731 284B inference in ~25 GB of RAM / Qwen3.8-Next-Flash inference in ~15 GB of RAM on any M-series MacBook

14918

SharpAI/SwiftLM

Swift

⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

78459

lithos-ai/lithos-metal

Python

lithos-metal: high-performance LLM inference kernels and serving for Apple silicon.

29924

jundot/omlx

Python

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

23k2.3k

drumih/turbo-fieldfare

Swift

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

7k491

youssofal/MTPLX

Python

The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculative decoding on Apple Silicon, exact at any temperature. OpenAI and Anthropic compatible local server.

2.6k217

nace-ai/kapitsa

C++

Blazing fast Apple Silicon optimized inference engine built for Qwen and Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai

15824

waybarrios/vllm-mlx

Python

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

1.6k257