ulab-uiuc/LLMRouter

Efficient LLM query routing via multi-sampling. BEST-Route selects both model and number of responses based on query difficulty, cutting costs by up to 60% with <1% performance drop. From the paper:https://arxiv.org/abs/2506.22716

RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderboard.

Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality

Route every prompt to the best LLM — for you specifically.

A curated list of awesome works in Routing LLMs paradigm (👉 Welcome to submit your contributions to this code repository)

An open, programmable decision layer for models and compute.

The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System

Per-step LLM routing benchmark with 970 static labels, live SWE-bench evaluation, an open data pipeline, and a public leaderboard.