MilkThink-Lab/Awesome-Routing-LLMs

Efficient LLM query routing via multi-sampling. BEST-Route selects both model and number of responses based on query difficulty, cutting costs by up to 60% with <1% performance drop. From the paper:https://arxiv.org/abs/2506.22716

LLMRouter: An Open-Source Library for LLM Routing

🎉 An awesome & curated list of best LLMOps tools.

RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderboard.

Per-step LLM routing benchmark with 970 static labels, live SWE-bench evaluation, an open data pipeline, and a public leaderboard.

Large Language Model (LLM) Systems Paper List

The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System

Simple CLI tool for deterministic routing of queries between local and hosted LLM models

Awesome-LLM: a curated list of Large Language Model