AWS 为 SageMaker AI 作业推出 SOCI 索引镜像加速启动
原标题:Announcing SOCI-indexed images for faster SageMaker AI jobs
AI 摘要
AWS 宣布为 Amazon SageMaker AI 的训练和处理作业提供 SOCI(Seekable OCI)索引镜像支持,通过懒加载容器镜像,只拉取启动所需文件并在后台流式加载其余部分。基准测试显示,1.8GB 至 35.4GB 镜像的下载时间从 48 秒至 7 分 17 秒降至 3 至 11 秒,GPU 空闲时间最多减少 90%,且不影响训练性能。用户只需使用预索引的 AWS 深度学习容器或为自己的镜像添加索引,无需修改作业定义。
正文节选
Announcing SOCI-indexed images for faster SageMaker AI jobs Every minute your deep learning container image spends downloading is a minute you pay for and a minute your team waits. Container image download is pure overhead: billable job time that produces no model progress. For modern deep learning images, that overhead is several minutes on every single job. Today, we’re excited to announce Seekable OCI (SOCI) indexing for Amazon SageMaker AI Training and Amazon SageMaker AI processing jobs, wh