Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

Bifrost
Bifrost
OfinTech Desk
OfinTech Desk
Busbar
Busbar
It's a plan
It's a plan
Omnigraph
Omnigraph

microsoft/sarathi-serve

A low-latency & high-throughput serving engine for LLMs

#LLM inference
Visit GitHub
Python
539
69
10 contributors
Apache License 2.0
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Busbar

Control what AI can do before it acts

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Momentum

How fast microsoft/sarathi-serve is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Nov 15 – Nov 19, 2026

Stars +1 in 5 days

01
1

Forks +1 in 5 days

01
1

Merged PRs 1 in 5 days

01
1

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Nov 15Nov 16Nov 17Nov 18Nov 19
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sun, Nov 15, 2026+0+10
Mon, Nov 16, 2026+0+00
Tue, Nov 17, 2026+0+01
Wed, Nov 18, 2026+1+00
Thu, Nov 19, 2026+0+00
Total+1+11
  • 1#1 on the list
  • 7Rank that day
  • Not trending

You might also like

Repositories close to microsoft/sarathi-serve
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Busbar

Control what AI can do before it acts

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

vllm-project/vllm

Python

A high-throughput and memory-efficient inference and serving engine for LLMs

97.2k24.9k

local-inference-lab/vllm

Python

A high-throughput and memory-efficient inference and serving engine for LLMs

4749

harleyszhang/rapid_llm

Python

RapidLLM is an LLM inference framework with continuous batching, tensor and data parallelism, quantized weights, and with pluggable Triton/CUDA kernels.

19833

inferflow/inferflow

C++

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

25324

ai-infos/vllm-gfx906-mobydick

Python

A high-throughput and memory-efficient inference and serving engine for LLMs - Optimized for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60

9514

hpcaitech/SwiftInfer

Python

Efficient AI Inference & Serving

47031

invergent-ai/surogate

C++

Train and serve LLMs at extreme speed and massive throughput.

88916

rh-aiservices-bu/sardeenz

TypeScript

Sardeenz is a proof-of-concept application that allows you to load more than one model on a given GPU. It allows you to add more and more models onto a GPU, until it is fully utilized.

658

naklecha/simple-llm

Python

~1300 line, minimal, extensible LLM inference engine built from scratch.

49338