Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

Bifrost
Bifrost
Busbar
Busbar
Omnigraph
Omnigraph
It's a plan
It's a plan
OfinTech Desk
OfinTech Desk

MohammadHaishemKhawaja/hashyy

A full, unpruned 177B MoE model at 11.5 tok/s on one 12 GB GPU. Expert streaming for llama.cpp, with the measurement harness and every dead end.

#LLM inference
Visit GitHub
Python
25
6
2 contributors
Custom license
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Busbar

Control what AI can do before it acts

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Momentum

How fast MohammadHaishemKhawaja/hashyy is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Oct 2 – Nov 19, 2026

Stars +25 in 49 days

0246
5

Forks +6 in 49 days

012
2

Merged PRs 0 in 49 days

01

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Oct 2Oct 9Oct 16Oct 23Oct 30Nov 6Nov 13
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Fri, Oct 2, 2026+0+00
Sat, Oct 3, 2026+5+20
Sun, Oct 4, 2026+4+10
Mon, Oct 5, 2026+3+00
Tue, Oct 6, 2026+4+00
Wed, Oct 7, 2026+2+00
Thu, Oct 8, 2026+0+00
Fri, Oct 9, 2026+1+10
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+1+00
Mon, Oct 12, 2026+1+00
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+0+10
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+0+00
Mon, Oct 19, 2026+1+00
Tue, Oct 20, 2026+0+00
Wed, Oct 21, 2026+0+00
Thu, Oct 22, 2026+0+00
Fri, Oct 23, 2026+0+00
Sat, Oct 24, 2026+0+00
Sun, Oct 25, 2026+0+00
Mon, Oct 26, 2026+0+00
Tue, Oct 27, 2026+0+00
Wed, Oct 28, 2026+0+00
Thu, Oct 29, 2026+0+00
Fri, Oct 30, 2026+0+00
Sat, Oct 31, 2026+0+00
Sun, Nov 1, 2026+1+00
Mon, Nov 2, 2026+0+00
Tue, Nov 3, 2026+1+00
Wed, Nov 4, 2026+1+10
Thu, Nov 5, 2026+0+00
Fri, Nov 6, 2026+0+00
Sat, Nov 7, 2026+0+00
Sun, Nov 8, 2026+0+00
Mon, Nov 9, 2026+0+00
Tue, Nov 10, 2026+0+00
Wed, Nov 11, 2026+0+00
Thu, Nov 12, 2026+0+00
Fri, Nov 13, 2026+0+00
Sat, Nov 14, 2026+0+00
Sun, Nov 15, 2026+0+00
Mon, Nov 16, 2026+0+00
Tue, Nov 17, 2026+0+00
Wed, Nov 18, 2026+0+00
Thu, Nov 19, 2026+0+00
Total+25+60
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Oct 61 post
    • A community expert-streaming run reports 11.5 tok/s for Qwen3.8-Flash-Next 177B UD-IQ3_XXS on an RTX 5070 12GB with 32GB RAM. I'd test my own prompts before treating disk-backed experts as a…

      Read full on X, posted by @sakurayukiai

      @sakurayukiai · x.com

  2. Oct 51 post
    • Qwen3.8-Flash-Next 177B at 11–15 tok/s on a single RTX 5070 12GB with 32GB DDR4 RAM [P]

      Read full on Reddit

      r/LLM

  3. Oct 42 posts
    • Qwen3.8-Flash-Next 177B running at 11–15 tok/s on 1 RTX 5070 12GB and 32GB RAM

      Read full on Hacker News

      Hacker News

    • Qwen3.8-Flash-Next 177B running at 11–15 tok/s on a single RTX 5070 12GB + 32GB RAM DDR4

      Read full on Reddit

      r/OpenSourceeAI

  4. Oct 31 post6 posts
    • Qwen3.8-Flash-Next 177B running at 11–15 tok/s on a single RTX 5070 12GB + 32GB RAM DDR4

      Read full on Reddit

      r/LLM

    • Qwen3.8-Flash-Next 177B at 11–15 tok/s on a single RTX 5070 12GB with 32GB DDR4 RAM

      Read full on Reddit

      r/ArtificialInteligence

    • Qwen3.8-Flash-Next 177B running at 11–15 tok/s on a single RTX 5070 12GB + 32GB RAM DDR4

      Read full on Reddit

      r/Qwen_AI

    • Qwen3.8-Flash-Next 177B running at 11–15 tok/s on a single RTX 5070 12GB + 32GB RAM DDR4

      Read full on Reddit

      r/u_Tommey_DZ

    • Qwen3.8-Flash-Next 177B running at 11–15 tok/s on a single RTX 5070 12GB + 32GB RAM DDR4

      Read full on Reddit

      r/LocalLLaMA

    • RTX 5070 12GB + 32GB RAM Qwen3.8-Flash-Next 177B running at ~ 11-15 tok/s

      Read full on Reddit

      r/nvidia

You might also like

Repositories close to MohammadHaishemKhawaja/hashyy
FeaturedAdvertise to 180K+ monthly visitors
OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Busbar

Control what AI can do before it acts

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

yalun753/moe-l2

Cuda

MoE expert offload for low-VRAM GPUs — run 100B+ MoE models (DeepSeek, Qwen, Mixtral) on 8 GB cards. Expert cache with LRU hot experts, OpenAI-compatible proxy, GGUF multi-shard.

1476

GenerelSchwerz/llama.cpp

C++

LLM inference in C/C++

14933

wici-ai/inferssd

C++

Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

1.2k108

miltos22/llama-wackMall

C++

Caching experts made model agnostic for llama. Drastically speeds up generation speed on MoE models that fully fit in the RAM but partially in Vram. WIP: Same speedup but for models that don't fit in the ram either.

3110

Helldez/BigMoeOnEdge

C++

Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

1k118

brontoguana/krasis

C++

Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware

53135

midagedev/bloomery

Rust

Hybrid GPU + CPU inference for mixture-of-experts models, written in Rust down to the CUDA kernels. A drop-in llama-server.

787

raketenkater/ggrun

Go

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

28521

IbrahimSiddiqui007/moe-cache

Python

Run Mixture-of-Experts LLMs (Qwen3, gpt-oss, GLM, DeepSeek) bigger than your RAM with llama.cpp: hot experts cached in RAM, the rest streamed from SSD. Windows (Vulkan/AMD, NVIDIA) and Linux, long context, coding agents.

221