NVIDIA NeMo Switchyard：跨模型路由 AI 代理工作负载
原标题：Route AI Agent Workloads Across Models with NVIDIA NeMo Switchyard
AI 摘要
NVIDIA 发布了 NeMo Switchyard，这是一个用于 AI 代理工作负载的模型路由库，允许开发者根据任务需求在多个模型之间路由请求，以平衡准确性、成本和延迟。该库支持多种路由算法，并提供与提供商无关的 SDK 和服务器参考实现，可接受 OpenAI、Anthropic 等 API 请求。通过智能路由，系统可以在复杂任务中使用更强大的模型，在简单任务中使用较小模型，从而优化整体性能。
正文节选
Building an AI agent does not end with choosing a single model. Each model has its own strengths, weaknesses, and cost profile, which can shift from one workload to another—or even within the same workload. For example, an agentic task may need classification for one step, reasoning for the next, and a smaller model for routine follow-up tasks. Sending every request to the largest model can increase cost and latency, while sending every request to a smaller model can reduce quality on complex ta