chiennv2000/orthrus

[NeurIPS 2026 Spotlight] Fast, lossless LLM inference via dual-view diffusion decoding.

Python

482

25

2 contributors

MIT License

FeaturedAdvertise to 180K+ monthly visitors

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

a benchmark for personal agents

Momentum

How fast chiennv2000/orthrus is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Aug 31 – Oct 24, 2026

Stars +9 in 55 days

2

Forks +3 in 55 days

1

Merged PRs 0 in 55 days

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Aug 31Sep 7Sep 14Sep 21Sep 28Oct 5Oct 12Oct 19

Stars, forks, merged pull requests and Trendshift Trending rank, by day
Day	Stars gained	Forks gained	Merged PRs
Mon, Aug 31, 2026	+1	+0	0
Tue, Sep 1, 2026	+0	+0	0
Wed, Sep 2, 2026	+2	+0	0
Thu, Sep 3, 2026	+1	+0	0
Fri, Sep 4, 2026	+0	+0	0
Sat, Sep 5, 2026	+0	+0	0
Sun, Sep 6, 2026	+0	+1	0
Mon, Sep 7, 2026	+0	+0	0
Tue, Sep 8, 2026	+0	+0	0
Wed, Sep 9, 2026	+0	+0	0
Thu, Sep 10, 2026	+0	+0	0
Fri, Sep 11, 2026	+0	+0	0
Sat, Sep 12, 2026	+0	+0	0
Sun, Sep 13, 2026	+0	+0	0
Mon, Sep 14, 2026	+1	+0	0
Tue, Sep 15, 2026	+0	+0	0
Wed, Sep 16, 2026	+0	+0	0
Thu, Sep 17, 2026	+0	+0	0
Fri, Sep 18, 2026	+0	+0	0
Sat, Sep 19, 2026	+0	+0	0
Sun, Sep 20, 2026	+0	+0	0
Mon, Sep 21, 2026	+0	+0	0
Tue, Sep 22, 2026	+0	+0	0
Wed, Sep 23, 2026	+0	+0	0
Thu, Sep 24, 2026	+0	+0	0
Fri, Sep 25, 2026	+0	+1	0
Sat, Sep 26, 2026	+0	+0	0
Sun, Sep 27, 2026	+0	+0	0
Mon, Sep 28, 2026	+0	+0	0
Tue, Sep 29, 2026	+2	+0	0
Wed, Sep 30, 2026	+0	+0	0
Thu, Oct 1, 2026	+0	+0	0
Fri, Oct 2, 2026	+0	+0	0
Sat, Oct 3, 2026	+0	+0	0
Sun, Oct 4, 2026	+0	+0	0
Mon, Oct 5, 2026	+0	+0	0
Tue, Oct 6, 2026	+0	+0	0
Wed, Oct 7, 2026	+0	+0	0
Thu, Oct 8, 2026	+0	+0	0
Fri, Oct 9, 2026	+0	+0	0
Sat, Oct 10, 2026	+0	+0	0
Sun, Oct 11, 2026	+0	+0	0
Mon, Oct 12, 2026	+0	+0	0
Tue, Oct 13, 2026	+0	+0	0
Wed, Oct 14, 2026	+1	+1	0
Thu, Oct 15, 2026	+0	+0	0
Fri, Oct 16, 2026	+1	+0	0
Sat, Oct 17, 2026	+0	+0	0
Sun, Oct 18, 2026	+0	+0	0
Mon, Oct 19, 2026	+0	+0	0
Tue, Oct 20, 2026	+0	+0	0
Wed, Oct 21, 2026	+0	+0	0
Thu, Oct 22, 2026	+0	+0	0
Fri, Oct 23, 2026	+0	+0	0
Sat, Oct 24, 2026	+0	+0	0
Total	+9	+3	0

#1 on the list
Rank that day
Not trending

Mentions and achievements

Where people are talking about chiennv2000/orthrus, and every badge it has earned

Jul 11 post
- Orthrus (diffusion head) trained Qwen 3.5/3.6 and Gemma 4 models are dropping soon
  Read full on Reddit
  r/softwarefactories
Jun 271 post
- Orthrus (diffusion head) trained Qwen 3.5/3.6 and Gemma 4 models are dropping soon
  Read full on Reddit
  r/LocalLLaMA
1 month earlier
May 241 post
- Beat autoregressive bottlenecks with lossless dual-view diffusion decoding for LLMs. 🚀 • High-speed parallel token generation ⚡ • Exact model generation fidelity 🎯 📦 orthrus ⭐ 358 🐍 Python #LLM…
  Read full on X, posted by @Marco_Ramilli
  @Marco_Ramilli · x.com
May 182 posts
- Orthrus-Qwen3: 7.8x tokens/forward on Qwen3 with identical output distribution. Open-source library that speeds up Qwen3 inference without changing results. Drop-in optimization for anyone running…
  Read full on X, posted by @so_sthbryan
  @so_sthbryan · x.com
- 打破 LLM 自回归顺序生成的瓶颈，用双架构扩散模型实现并行 token 生成，在保证输出完全无损的前提下将推理速度提升 4-7.8 倍。 Orthrus 给现有的 LLM 加了一个扩散解码的"并行视图"。两个视图读同一份 KV 缓存，不需要重复存上下文，内存开销可以忽略。基座模型冻结不动，只微调 16% 的参数就能跑起来。实测在 Qwen3 的三个尺寸上平均加速 4-5 倍，最高 7.8…
  Read full on X, posted by @QingQ77
  @QingQ77 · x.com
May 164 posts
- Orthrus-Qwen3: up to 7.8×tokens/forward on Qwen3, identical output distribution (
  Read full on X, posted by @betterhn20
  @betterhn20 · x.com
- Orthrus-Qwen3: up to 7.8×tokens/forward on Qwen3, identical output distribution (
  Read full on X, posted by @betterhn50
  @betterhn50 · x.com
- The interesting claim in Orthrus isn’t just “faster LLMs.” It’s: parallel generation + strict distribution matching + shared KV cache If this holds up, it blurs the line between autoregressive and…
  Read full on X, posted by @VarunrRao
  @VarunrRao · x.com
- Orthrus: lossless LLM inference at up to 7.8x speedup via dual-view diffusion on Qwen3. 8B model averages 5.36x faster. Identical output distribution. No quality degradation. If you run local models…
  Read full on X, posted by @hirenthakore
  @hirenthakore · x.com
May 151 post
- Orthrus-Qwen3: up to 7.8×tokens/forward on Qwen3, identical output distribution
  Read full on Hacker News
  Hacker News