Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
ยฉ 2026 Trendshift, created by Julian Li with โค๏ธ
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

Bifrost
Bifrost
Busbar
Busbar

synchopate/llama-modchip

๐Ÿ‹ Run 284B DeepSeek-V4-Flash (<59GiB RAM, 44.4 tok/s pp, 9.1-14.7 tok/s) & 30B MoEs (25-111 tok/s) on a pure 64GB CPU at 256K ctx (0 GPUs). SwiGLU-H2, Stockfish-PVS L3 & 13ms Claude Code restore.

#LLM inference
Visit GitHub
Python
326
19
1 contributors
Apache License 2.0
website
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Busbar

Control what AI can do before it acts

Momentum

How fast synchopate/llama-modchip is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Octย 30ย โ€“ Novย 8,ย 2026

Stars +319 in 10 days

0100200300
290

Forks +19 in 10 days

0510
7

Merged PRs 0 in 10 days

01

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Oct 30Nov 1Nov 3Nov 5Nov 7
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Fri, Oct 30, 2026+0+40
Sat, Oct 31, 2026+7+70
Sun, Nov 1, 2026+2+10
Mon, Nov 2, 2026+3+00
Tue, Nov 3, 2026+1+00
Wed, Nov 4, 2026+0+00
Thu, Nov 5, 2026+1+00
Fri, Nov 6, 2026+1+00
Sat, Nov 7, 2026+14+10
Sun, Nov 8, 2026+290+60
Total+319+190
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Nov 85 posts
    • If results like this hold up, companies could run large models on machines they already own, with data that never leaves the building. Would your team run AI locally if the hardware bill dropped thisโ€ฆ

      Read full on X, posted by @tschauhan

      @tschauhan ยท x.com

    • Synchopate reports a 284.33B-parameter model running on pure CPU in 64 GB RAM, zero GPUs. The repo (llama-modchip v2.4.0) claims DeepSeek-V4-Flash, a MoE with 13.17B active params, fits at 56.56 GiBโ€ฆ

      Read full on X, posted by @Agent_Jace

      @Agent_Jace ยท x.com

    • 284b deepseek on a 64 gb cpu is on hn. did the math on the readme: 56.56 gib for 284.33b params = 1.71 bits per weight. the moe experts are iq1_s, ~1.56 bits. "lossless" there means same output as anโ€ฆ

      Read full on X, posted by @daniiie7

      @daniiie7 ยท x.com

    • Llama-modchip: 284B DeepSeek on 64GB RAM, no GPU #HackerNews

      Read full on X, posted by @hackernewstop5

      @hackernewstop5 ยท x.com

    • Llama-modchip: 284B DeepSeek on 64GB RAM, no GPU

      Read full on Hacker News

      Hacker News

You might also like

Repositories close to synchopate/llama-modchip
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Busbar

Control what AI can do before it acts

baker27727/ds4-8gb-cpu

C

DeepSeek V4 Flash CPU/NVMe research fork: 78.62 GiB GGUF validated on 7.7 GiB RAM, CPU-only, using demand paging.

4011

Fringe210/llama.cpp-deepseek-v4-flash-cuda

C++

Experimental implementation of DeepSeek v4 flaash in llama.cpp

244

sqliteai/warp

C

Run the full 2.78-trillion-parameter Kimi K3 model, DeepSeek V4.1 Flash or GLM-5.3-Flash beyond available RAM by streaming activated weights directly from NVMe. A dependency-free, embeddable C inference engine.

2.5k205

shawnshekari/strixite

C++

LLM inference engine written from scratch in HIP for AMD Strix Halo (gfx1151) and Qwen3.8-Flash-Next - ~50 tokens/s out to 492k context

9913

lucienhuangfu/eLLM

Rust

eLLM: Run Long-Horizon Inference Faster on CPUs Than on GPUs

60160

alesha-pro/llama.cpp

C++

LLM inference in C/C++

5610

coderredlab/runNburn

Rust

Memory-aware GGUF inference runtime with OpenAI-compatible serving

282

Entrpi/ds4

C

CUDA Blackwell performance fork of antirez/ds4 (DeepSeek-V4-Flash): ~4x prefill, ~1.5x decode, continuous batching, weight server, DSpark

7717

arizqi/cpubrrr

Rust

Frontier-class LLM inference on a laptop CPU โ€” gpt-oss:20b at ~110 tok/s on Apple M4 Max, 7.5x llama.cpp, no GPU. From-scratch NEON/SME kernels in Rust.

576