NVIDIA Mission Control 2.5 为 Kubernetes 带来自主恢复能力
原标题：How NVIDIA Mission Control 2.5 Brings Autonomous Recovery to Kubernetes
AI 摘要
NVIDIA 发布 Mission Control 2.5，将其自主恢复引擎从原先仅支持 Slurm 的 HPC 工作负载，扩展到由 NVIDIA Run:ai 管理的 Kubernetes 工作负载。该引擎由自主作业恢复和自主硬件恢复两项服务组成，与调度器协同形成三层框架，可检测、诊断并自动恢复 GPU 故障或作业异常，减少停机与算力浪费。此举旨在帮助 AI 工厂从被动运维转向自愈型基础设施。
正文节选
Training large-scale AI models on thousands of GPUs is a high-stakes operation where monitoring and automation must be built-in to optimize cluster resiliency and uptime at scale. This concept isn’t new to data center operators who have measured mean-time-to-repair (MTTR) and mean-time-between-failure (MTBF) long before AI factories existed. Now the stakes are higher. Modern AI factories run distributed training jobs across hundreds of nodes for days or weeks, and at this scale the operating mod