GKE Pod 快照将模型加载时间缩短 89%,但快照生命周期管理成为新难题
原标题:GKE Pod Snapshots Cut Model Load Times, and Move the Work to Snapshot Lifecycle Management
AI 摘要
Google 公布了 GKE Pod 快照的基准测试结果,称启动延迟最高可降低 89%,70B 参数模型加载仅需 37 秒、8B 模型 15 秒。该功能基于 gVisor 实现检查点与恢复,可保存 CPU/GPU 内存及运行状态,已于 5 月正式可用。但从业者指出,快照失效管理(模型摘要、CUDA/驱动版本、GPU 拓扑等兼容性键)以及恢复后的密钥、环境变量、外部连接重建,才是更难的平台问题。
正文节选
Google has published benchmark results for GKE Pod snapshots, reporting startup latency reductions of as much as 89%, with a 70B parameter model loading in 37 seconds and an 8B model in 15 seconds. The feature saves the running state of a workload, including CPU and GPU memory, and restores it on demand. It reached general availability in May on clusters running version 1.35.3-gke.1234000 or later. This is checkpoint and restore, not caching. The snapshot holds everything the application had run