Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost

sizzlecar/ferrum-infer-rs

A Rust-native LLM serving engine. One binary, no Python runtime.

#LLM inference
Visit GitHub
Rust
22
1
3 contributors
MIT License
website
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast sizzlecar/ferrum-infer-rs is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 5 – Nov 4, 2026

Stars +11 in 61 days

012
2

Forks +0 in 61 days

01

Merged PRs 230 in 61 days

01020
20

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 5Sep 13Sep 21Sep 29Oct 7Oct 15Oct 23Oct 31
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sat, Sep 5, 2026+0+014
Sun, Sep 6, 2026+1+019
Mon, Sep 7, 2026+0+012
Tue, Sep 8, 2026+2+05
Wed, Sep 9, 2026+0+014
Thu, Sep 10, 2026+2+020
Fri, Sep 11, 2026+1+04
Sat, Sep 12, 2026+0+00
Sun, Sep 13, 2026+1+00
Mon, Sep 14, 2026+0+01
Tue, Sep 15, 2026+0+010
Wed, Sep 16, 2026+0+06
Thu, Sep 17, 2026+0+06
Fri, Sep 18, 2026+0+03
Sat, Sep 19, 2026+0+05
Sun, Sep 20, 2026+0+012
Mon, Sep 21, 2026+0+00
Tue, Sep 22, 2026+0+00
Wed, Sep 23, 2026+0+00
Thu, Sep 24, 2026+0+00
Fri, Sep 25, 2026+0+00
Sat, Sep 26, 2026+0+00
Sun, Sep 27, 2026+1+00
Mon, Sep 28, 2026+0+00
Tue, Sep 29, 2026+1+00
Wed, Sep 30, 2026+0+00
Thu, Oct 1, 2026+0+00
Fri, Oct 2, 2026+0+00
Sat, Oct 3, 2026+0+00
Sun, Oct 4, 2026+0+00
Mon, Oct 5, 2026+0+00
Tue, Oct 6, 2026+0+01
Wed, Oct 7, 2026+0+00
Thu, Oct 8, 2026+0+00
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+0+01
Mon, Oct 12, 2026+0+00
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+0+07
Fri, Oct 16, 2026+0+06
Sat, Oct 17, 2026+0+012
Sun, Oct 18, 2026+0+012
Mon, Oct 19, 2026+0+00
Tue, Oct 20, 2026+0+07
Wed, Oct 21, 2026+1+00
Thu, Oct 22, 2026+0+00
Fri, Oct 23, 2026+0+02
Sat, Oct 24, 2026+0+02
Sun, Oct 25, 2026+0+01
Mon, Oct 26, 2026+0+05
Tue, Oct 27, 2026+0+01
Wed, Oct 28, 2026+0+08
Thu, Oct 29, 2026+0+09
Fri, Oct 30, 2026+0+05
Sat, Oct 31, 2026+0+02
Sun, Nov 1, 2026+0+08
Mon, Nov 2, 2026+0+05
Tue, Nov 3, 2026+1+05
Wed, Nov 4, 2026+0+00
Total+11+0230
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Nov 31 post

    • Ferrum 🦀 Rust inference for text + images. RTX 5090 benchmarks: Qwen3.5 4B/9B Q4_K_M: 1.51×/1.33× llama.cpp at C8 GPT-OSS 20B MXFP4: 109%/97% of vLLM at C8/C16 All listed results meet latency SLOs.…

      Read full on X, posted by @jinxuan_ai

      @jinxuan_ai · x.com

  2. 2 months earlier
  3. Sep 181 post

    • Orchestral 0.4 - a Rust agent runtime that reads model options from your provider

      Read full on Reddit

      r/SideProject

  4. 10 days earlier
  5. Sep 81 post

    • Ferrum 0.8.8: a Rust local LLM runtime with Metal and CUDA backends

      Read full on Reddit

      r/rust

  6. Sep 41 post

    • I fixed a Ferrum bug where a long prompt paused replies already streaming. RTX 4050 / Qwen3.5-0.8B FP16, 3 runs. Mean p95 output-event gap fell from 1115 to 175 ms; the new request's first output…

      Read full on X, posted by @jinxuan_ai

      @jinxuan_ai · x.com

  7. Sep 11 post

    • I built a single-binary Rust LLM server for Apple Silicon — looking for blunt onboarding feedback

      Read full on Reddit

      r/sideprojects

  8. 3 months earlier
  9. Jun 61 post

    • Ferrum Infer v0.7.6 released. Reliability-focused release: •structured output + tool call hardening •cache observability •startup LoRA routing Rust-native inference between llama.cpp and vLLM.

      Read full on X, posted by @jinxuan_ai

      @jinxuan_ai · x.com

You might also like

Repositories close to sizzlecar/ferrum-infer-rs
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

EricLBuehler/mistral.rs

Rust

Fast, flexible LLM inference

7.8k782

guoqingbao/xinfer

Rust

Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.

34552

Avarok-Cybersecurity/atlas

Rust

Pure Rust Inference Engine

713110

ling0322/libllm

C++

A lightweight vLLM-style inference engine in Rust

1546

pegainfer-project/pegainfer

Rust

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

731126

Gilfeather/furnace

Rust

Fast, Unified, Rust-Native, Axum-Compatible inference Endpoints for Burn models and LLMs

666

vllm-project/vllm

Python

A high-throughput and memory-efficient inference and serving engine for LLMs

96.2k24.1k

hpcaitech/SwiftInfer

Python

Efficient AI Inference & Serving

47231

samuel-vitorino/lm.rs

Rust

Minimal LLM inference in Rust

1k45