Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost

Luce-Org/lucebox

LLM speculative inference server for heterogeneous hardware & consumer GPUs

#LLM inference
Visit GitHub
C++
3k
308
42 contributors
Apache License 2.0
website
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast Luce-Org/lucebox is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 7 – Nov 6, 2026

Stars +143 in 61 days

0510
7

Forks +32 in 61 days

0123
3

Merged PRs 200 in 61 days

051015
12

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 7Sep 15Sep 23Oct 1Oct 9Oct 17Oct 25Nov 2
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Mon, Sep 7, 2026+0+36
Tue, Sep 8, 2026+4+07
Wed, Sep 9, 2026+0+03
Thu, Sep 10, 2026+5+12
Fri, Sep 11, 2026+2+00
Sat, Sep 12, 2026+1+06
Sun, Sep 13, 2026+0+12
Mon, Sep 14, 2026+5+05
Tue, Sep 15, 2026+3+13
Wed, Sep 16, 2026+7+11
Thu, Sep 17, 2026+3+02
Fri, Sep 18, 2026+0+02
Sat, Sep 19, 2026+1+00
Sun, Sep 20, 2026+1+10
Mon, Sep 21, 2026+1+02
Tue, Sep 22, 2026+2+00
Wed, Sep 23, 2026+4+03
Thu, Sep 24, 2026+2+310
Fri, Sep 25, 2026+4+03
Sat, Sep 26, 2026+1+08
Sun, Sep 27, 2026+1+02
Mon, Sep 28, 2026+1+04
Tue, Sep 29, 2026+0+06
Wed, Sep 30, 2026+2+24
Thu, Oct 1, 2026+0+18
Fri, Oct 2, 2026+4+00
Sat, Oct 3, 2026+3+11
Sun, Oct 4, 2026+3+02
Mon, Oct 5, 2026+2+10
Tue, Oct 6, 2026+1+05
Wed, Oct 7, 2026+0+03
Thu, Oct 8, 2026+3+08
Fri, Oct 9, 2026+3+05
Sat, Oct 10, 2026+4+02
Sun, Oct 11, 2026+3+12
Mon, Oct 12, 2026+2+02
Tue, Oct 13, 2026+2+03
Wed, Oct 14, 2026+2+24
Thu, Oct 15, 2026+4+11
Fri, Oct 16, 2026+3+00
Sat, Oct 17, 2026+2+11
Sun, Oct 18, 2026+2+04
Mon, Oct 19, 2026+6+00
Tue, Oct 20, 2026+6+00
Wed, Oct 21, 2026+2+17
Thu, Oct 22, 2026+3+04
Fri, Oct 23, 2026+7+14
Sat, Oct 24, 2026+1+05
Sun, Oct 25, 2026+0+05
Mon, Oct 26, 2026+5+11
Tue, Oct 27, 2026+0+00
Wed, Oct 28, 2026+3+06
Thu, Oct 29, 2026+0+03
Fri, Oct 30, 2026+3+07
Sat, Oct 31, 2026+3+00
Sun, Nov 1, 2026+1+24
Mon, Nov 2, 2026+2+15
Tue, Nov 3, 2026+6+112
Wed, Nov 4, 2026+0+32
Thu, Nov 5, 2026+1+10
Fri, Nov 6, 2026+1+03
Total+143+32200
  • 1#1 on the list
  • 7Rank that day
  • Not trending

    • Mentions and achievements

    Where people are talking about Luce-Org/lucebox, and every badge it has earned
    1. Sep 251 post

      • Both models can run at the same time on one box: 58 image answers a minute, against 18 on the DGX Spark, which can't load both. A big-memory APU for the large model and a GPU for the bandwidth-bound…

        Read full on X, posted by @davideciffa

        @davideciffa · x.com

    2. 20 days earlier
    3. Sep 51 post

      • Paged KV shrank Qwen3.6's ragged 8-request cache from 18GB to 3.23GB and sped attention 1.35x. But 48 of 64 layers are recurrent. Once their state is sequence-indexed, does whole-model throughput…

        Read full on X, posted by @sakurayukiai

        @sakurayukiai · x.com

    4. 25 days earlier
    5. Aug 111 post

      • Starting experiments!

        Read full on X, posted by @auryn_macmillan

        @auryn_macmillan · x.com

    6. 1 month earlier
    7. Jul 111 post

      • https://t.co/MakeLAVsIc

        Read full on X, posted by @pupposandro

        @pupposandro · x.com

    8. 25 days earlier
    9. Jun 161 post

      • 256K context with 72MiB of KV cache on the GPU

        Read full on Hacker News

        Hacker News

    10. Jun 151 post

      • This is amazing. Token speed doubled + kv cache now need low vram - qwen 27b

        Read full on Reddit

        r/LocalLLaMA

    11. Jun 141 post

      • Very proud to share that we just release Luce KVFlash. Run your preferred model inside Lucebox at 256k context, without thinking about KVCache and OOM, up to 2.9x faster decoding at long context.…

        Read full on X, posted by @davideciffa

        @davideciffa · x.com

    12. Jun 111 post

      • The cuda12 image is a fat binary: nvcc emits device code for every architecture in the list, and the right kernels get picked at runtime. Nothing to detect, nothing to rebuild if you swap GPUs.

        Read full on X, posted by @pupposandro

        @pupposandro · x.com

    13. Jun 81 post

      • Luce Spark: a 35B MoE on a 16 GB GPU, without the offload tax

        Read full on Reddit

        r/LocalLLaMA

    14. 11 days earlier
    15. May 281 post

      • A 26B model on a 24 GB laptop tied a 284B model on a 192 GB Mac Studio. Both 78.3% on ds4-eval-92, the eval ported from @antirez's ds4 (huge fans of all his work on it). To be honest DeepSeek V4…

        Read full on X, posted by @pupposandro

        @pupposandro · x.com

    You might also like

    Repositories close to Luce-Org/lucebox
    FeaturedAdvertise to 180K+ monthly visitors
    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    Tiiny-AI/PowerInfer

    C++

    High-speed Large Language Model Serving for Local Deployment

    9.9k659

    jitllm/jitllm

    Go

    Smart inference engine that adapts to your hardware to run models faster, even when they don’t fit in memory

    585

    Avarok-Cybersecurity/atlas

    Rust

    Pure Rust Inference Engine

    713110

    turboderp-org/exllamav3

    Python

    An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

    1.8k296

    turboderp-org/exllamav2

    Python

    A fast inference library for running LLMs locally on modern consumer-class GPUs

    4.7k353

    labscommunity/cascadia

    Rust

    Run any model on Intel silicon

    511

    brontoguana/krasis

    C++

    Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware

    52635

    Atlas-Inf/atlas

    Rust

    Atlas Inference is a dependency free lightweight inference engine meant to run LLMs on YOUR compute seamlessly. Supports GB10 and Strix Halo at the moment, hoping to expand to more!

    379

    ashhart/TensorFold

    Zig

    LLM Inference Engine for Metal, CUDA and Vulkan.

    1.7k329