DeepSpeed v0.19.0 发布：多模态支持与多项修复

AI 摘要

DeepSpeed 发布 v0.19.0 版本，包含多项修复和功能增强，如 ZeRO-3 碎片整理工具、序列并行对多模态模型的支持、Muon 优化器的 Gram 正交化，以及多个 bug 修复。该版本提升了稳定性、兼容性和性能，对使用 DeepSpeed 进行大规模模型训练的用户有积极影响。

正文节选

## What's Changed * Update version after latest release (v0.18.9) by @loadams in https://github.com/deepspeedai/DeepSpeed/pull/7936 * Refactor consolidate transpose by @nathon-lee in https://github.com/deepspeedai/DeepSpeed/pull/7934 * Fix/fix autotp universal checkpoint ci by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7937 * Fix process hang in process-group shutdown by @Flamefire in https://github.com/deepspeedai/DeepSpeed/pull/7941 * Zero3 defragment utility by @nathon-lee

发布时间：2026-05-07 05:47

抓取时间：2026-08-02 00:31

来源机构：Microsoft