Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

Bifrost
Bifrost

thu-nics/TokenRouter

[NeurIPS'26] The official code implementation for paper "TokenRouter: Efficient Serving System for Token-Level LLM Routing"

Visit GitHub
Python
65
6
2 contributors
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast thu-nics/TokenRouter is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Oct 8 – Oct 28, 2026

Stars +45 in 21 days

051015
12

Forks +6 in 21 days

012
2

Merged PRs 2 in 21 days

012
2

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Oct 8Oct 11Oct 14Oct 17Oct 20Oct 23Oct 26
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Thu, Oct 8, 2026+0+00
Fri, Oct 9, 2026+2+00
Sat, Oct 10, 2026+7+20
Sun, Oct 11, 2026+12+10
Mon, Oct 12, 2026+11+20
Tue, Oct 13, 2026+4+00
Wed, Oct 14, 2026+2+00
Thu, Oct 15, 2026+0+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+1+00
Mon, Oct 19, 2026+3+10
Tue, Oct 20, 2026+1+02
Wed, Oct 21, 2026+0+00
Thu, Oct 22, 2026+0+00
Fri, Oct 23, 2026+1+00
Sat, Oct 24, 2026+0+00
Sun, Oct 25, 2026+0+00
Mon, Oct 26, 2026+1+00
Tue, Oct 27, 2026+0+00
Wed, Oct 28, 2026+0+00
Total+45+62
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Oct 121 post
    • 🔥A NeurIPS 2026 paper from Tsinghua researchers, TokenRouter, is now open source. TokenRouter is a serving system for token-level LLM routing. You describe routing logic through three interfaces:…

      Read full on X, posted by @Chinazhidx

      @Chinazhidx · x.com

  2. Oct 102 posts
    • Verdict: Solid result, will likely replicate — controlled experimental design, open code, and clear architectural contribution. No red flags on methodology.

      Read full on X, posted by @AIEnthusiast26x

      @AIEnthusiast26x · x.com

    • 一个回答里只有 5% 的字要大模型写:token 级路由小模型打底、32B 只接难点,质量追平,但没系统跑得动。 清华 TokenRouter 给每个模型配异步子服务,切换原地续上。 解码吞吐最高 64 倍,NeurIPS 2026 接收,代码开源。 #大模型 #TokenRouter #NeurIPS

      Read full on X, posted by @ataosky

      @ataosky · x.com

  3. Oct 91 post
    • TokenRouter: Efficient Serving System for Token-Level LLM Routing A new serving engine that decouples routing logic from execution, using delayed batching to achieve 2-64x higher throughput than…

      Read full on X, posted by @HuggingPapers

      @HuggingPapers · x.com

You might also like

Repositories close to thu-nics/TokenRouter
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

thu-nics/R2R

Python

[NeurIPS'25] The official code implementation for paper "R2R: Efficiently Navigating Divergent Reasoning Paths with Small-Large Model Token Routing"

10315

ulab-uiuc/LLMRouter

Python

LLMRouter: An Open-Source Library for LLM Routing

3k331

microsoft/best-route-llm

Python

Efficient LLM query routing via multi-sampling. BEST-Route selects both model and number of responses based on query difficulty, cutting costs by up to 60% with <1% performance drop. From the paper:https://arxiv.org/abs/2506.22716

7013

withmartian/routerbench

Python

The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System

18735

MilkThink-Lab/Awesome-Routing-LLMs

Python

A curated list of awesome works in Routing LLMs paradigm (👉 Welcome to submit your contributions to this code repository)

18916

RouteWorks/RouterArena

Python

RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderboard.

15257

CommonstackAI/TwinRouterBench

Python

Per-step LLM routing benchmark with 970 static labels, live SWE-bench evaluation, an open data pipeline, and a public leaderboard.

284

lm-sys/RouteLLM

Python

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality

5.6k449

harrrshall/tinyrouter

Python

A tiny ~10K-parameter LLM router that learns which open-source model (deepseek-v4-pro / glm-5p2 / kimi-k2p6 via Fireworks) should answer each question and in what role, trained by evolution (sep-CMA-ES).

31536