NVIDIA PAIR 测试版:本地网络虚拟推理路由器扩展 AI 计算
原标题:NVIDIA PAIR Virtual Inference Router Expands Available Compute on Your Local Network
AI 摘要
NVIDIA 发布了 Personal AI Router (PAIR) 的测试版,这是一个虚拟推理路由器,可将本地网络中的多台设备(如 RTX AI PC、DGX Spark 等)组合成动态计算集群,以缓解多智能体工作负载下的 GPU 瓶颈。PAIR 通过代理兼容 Ollama 和 LM Studio 接口,无需修改智能体代码即可将请求路由到可用节点。实测中,使用 PAIR 集群将五子智能体任务完成时间从 18 分钟缩短至 8 分钟。
正文节选
AI agents are learning to do more by working together. A lead agent can break a complex task into smaller jobs and assign those jobs to specialized subagents. Additionally, users are starting to run multiple agent sessions at the same time. Multi-agent workflows for accomplishing complex tasks are also becoming more common. This breadth-first approach can improve the speed of task completion and improve the quality of responses, but it can also bottleneck the system as many requests are sent to