Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

Busbar
Busbar
Omnigraph
Omnigraph
It's a plan
It's a plan
OfinTech Desk
OfinTech Desk
Bifrost
Bifrost

mit-han-lab/EvolvingInfra

A inference framework that adapt to diverse and dynamic agent workload

#LLM inference
Visit GitHub
Python
152
12
5 contributors
Custom license
website
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast mit-han-lab/EvolvingInfra is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Nov 12 – Nov 19, 2026

Stars +105 in 8 days

02040
37

Forks +12 in 8 days

024
4

Merged PRs 22 in 8 days

051015
11

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Nov 12Nov 13Nov 14Nov 15Nov 16Nov 17Nov 18Nov 19
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Thu, Nov 12, 2026+0+011
Fri, Nov 13, 2026+0+02
Sat, Nov 14, 2026+0+31
Sun, Nov 15, 2026+1+21
Mon, Nov 16, 2026+20+03
Tue, Nov 17, 2026+36+41
Wed, Nov 18, 2026+37+33
Thu, Nov 19, 2026+11+00
Total+105+1222
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Nov 181 post
    • Evolving Infra: Agent-Adaptive LLM Serving at Scale

      Read full on Hacker News

      Hacker News

  2. Nov 151 post
    • Ion Stoica, Song Han and collaborators from @NVIDIAAIDev, MIT, UC Berkeley and Georgia Tech just released a serving system built for AI agents! ⚡ "Evolving Infra: Agent-Adaptive LLM Serving at Scale"…

      Read full on X, posted by @paperswithcodee

      @paperswithcodee · x.com

You might also like

Repositories close to mit-han-lab/EvolvingInfra
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Busbar

Control what AI can do before it acts

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

ai-dynamo/dynamo

Rust

A Datacenter Scale Distributed Inference Serving Framework

8.5k1.9k

vllm-project/aibrix

Go

Cost-efficient and pluggable Infrastructure components for GenAI inference

5.2k792

openJiuwen-ai/agent-infer

Python

vLLM based inference framework for agentic workload.

10817

intentee/paddler

Rust

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

1.7k128

xLLM-AI/xllm-service

C++

A flexible serving framework that delivers efficient and fault-tolerant LLM inference for clustered deployments.

10040

pie-project/pie

Rust

A programmable system for high-performance model serving

24441

sihyeong/Awesome-LLM-Inference-Engine

25543

LLMServe/DistServe

Jupyter Notebook

Disaggregated serving system for Large Language Models (LLMs).

847101

casys-kaist/llmservingsim

Python

LLMServingSim 2.0: A Unified Simulator for Heterogeneous and Disaggregated LLM Serving Infrastructure

476132