withmartian/routerbench

RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderboard.

Per-step LLM routing benchmark with 970 static labels, live SWE-bench evaluation, an open data pipeline, and a public leaderboard.

[Findings@ACL'26] LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing

[ECCV'26] MMR-Bench: A Comprehensive Benchmark for Multimodal LLM Routing

LLMRouter: An Open-Source Library for LLM Routing

Efficient LLM query routing via multi-sampling. BEST-Route selects both model and number of responses based on query difficulty, cutting costs by up to 60% with <1% performance drop. From the paper:https://arxiv.org/abs/2506.22716

A curated list of awesome works in Routing LLMs paradigm (👉 Welcome to submit your contributions to this code repository)

[NeurIPS'26] The official code implementation for paper "TokenRouter: Efficient Serving System for Token-Level LLM Routing"

Local-first CLI for benchmarking LLMs on real hardware — quality, speed, reliability, and a real multi-turn agent loop.