Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost

rulith-dev/rulith-inference

Rulith Inference, formerly Strix Llama. Serving a 125B MoE model fast on one AMD Strix Halo machine, on Windows: a patched llama.cpp, a manager, and a desktop app.

#LLM inference
Visit GitHub
Python
44
5
2 contributors
MIT License
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

Momentum

How fast rulith-dev/rulith-inference is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 23 – Oct 26, 2026

Stars +39 in 34 days

0246
6

Forks +5 in 34 days

012
2

Merged PRs 0 in 34 days

01

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 23Sep 28Oct 3Oct 8Oct 13Oct 18Oct 23
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Wed, Sep 23, 2026+0+00
Thu, Sep 24, 2026+0+00
Fri, Sep 25, 2026+0+00
Sat, Sep 26, 2026+5+10
Sun, Sep 27, 2026+2+00
Mon, Sep 28, 2026+1+00
Tue, Sep 29, 2026+2+00
Wed, Sep 30, 2026+0+00
Thu, Oct 1, 2026+5+00
Fri, Oct 2, 2026+2+00
Sat, Oct 3, 2026+0+00
Sun, Oct 4, 2026+0+00
Mon, Oct 5, 2026+0+00
Tue, Oct 6, 2026+0+10
Wed, Oct 7, 2026+1+00
Thu, Oct 8, 2026+1+00
Fri, Oct 9, 2026+3+10
Sat, Oct 10, 2026+6+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+0+00
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+1+00
Fri, Oct 16, 2026+1+00
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+0+00
Mon, Oct 19, 2026+1+00
Tue, Oct 20, 2026+0+00
Wed, Oct 21, 2026+1+00
Thu, Oct 22, 2026+2+00
Fri, Oct 23, 2026+1+00
Sat, Oct 24, 2026+2+00
Sun, Oct 25, 2026+0+20
Mon, Oct 26, 2026+2+00
Total+39+50
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Oct 11 post

    • Rulith Inference (formerly Strix Llama) 0.4: 125B MoE on a 395 under Windows, ~100 tok/s across 8 conversations, and how I use it as a local worker for coding agents

      Read full on Reddit

      r/StrixHalo

  2. Sep 271 post

    • Qwen3.8-Flash-Next (125B MoE) at 36–45 tok/s and ~1200 t/s prefill on one Ryzen AI Max+ 395, on Windows: open-source runtime + installer

      Read full on Reddit

      r/LocalLLM

  3. Sep 251 post

    • Strix Llama: Qwen3.8-Flash-Next (125B MoE) at ~1180 t/s prefill and 33-41 tok/s decode on a Ryzen AI Max+ 395 (Windows installer, open source)

      Read full on Reddit

      r/StrixHalo

You might also like

Repositories close to rulith-dev/rulith-inference
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

am17an/llama.cpp

C++

LLM inference in C/C++

5722

eddoursul/StrataFast

C++

A fork of https://github.com/Niko1221/Strata optimized for my 3090+5070 Ti setup, see docs/COMPARISON.md. Renamed to StrataFast.

525

Atlas-Inf/atlas

Rust

Atlas Inference is a dependency free lightweight inference engine meant to run LLMs on YOUR compute seamlessly. Supports GB10 and Strix Halo at the moment, hoping to expand to more!

369

giveen/ninfer-studio

TypeScript

Desktop UI for the NInfer local LLM inference engine

322

FlashML-org/FreeToken

Python

FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

14.8k1.5k

labscommunity/cascadia

Rust

Run any model on Intel silicon

521

panbanda/higgs

Rust

A rust mlx server, ui, and model router for fast, dependency free inference on apple architecture

346

Niko1221/Strata

C++

Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

32.9k3.5k

thomas9120/gufo-windows

C++

Gufo officially supports Windows as of October 25, 2026. This fork will be winding down releases.

244