LLMRouter：用于开发、评估和部署 LLM 路由器的统一基础设施

AI 摘要

LLMRouter 论文提出了一个统一的 LLM 路由基础设施，将路由形式化为包含五个组件的顺序决策过程，并构建了覆盖多种任务的 xRouteBench 基准。该框架包含 16 种以上的路由方法，实验表明学习型路由器比最强固定模型基线相对提升 14.6%，并支持从训练到部署的端到端流程。

正文节选

LLMRouter: Unified Infrastructure for Developing, Evaluating, and Deploying LLM Routers Abstract LLM routing is formalized as a sequential decision process with a unified benchmark and modular infrastructure to compare and improve cost-effective model selection. No single large language model (LLM) is optimal across all queries and budget constraints, making model routing essential for cost-effective deployment. Existing routers adopt diverse formulations and implementations, making fair compari

发布时间：—

抓取时间：2026-08-14 12:47

来源机构：Hugging Face