NVIDIA与Hugging Face合作推出NeMo Automodel,简化扩散模型分布式微调
原标题:Fine-tune video and image models at scale with NVIDIA NeMo Automodel and 🤗 Diffusers
AI 摘要
NVIDIA与Hugging Face合作,推出NVIDIA NeMo Automodel开源库,支持对Diffusers格式的扩散模型进行分布式微调,无需转换检查点或重写模型。该库支持流匹配模型,提供全参数和LoRA微调,并支持FSDP2、张量并行等多种并行策略,可扩展至数百GPU。已为Wan 2.1、FLUX.1-dev、HunyuanVideo等模型提供现成微调配方。
正文节选
Diffusion models power some of the most exciting open-source releases of the last two years — such as FLUX.1-dev for text-to-image and Wan 2.1 and HunyuanVideo for text-to-video. The 🤗 Diffusers library has become the de facto home for these models, giving researchers and builders a single, consistent interface for inference, adaptation, and pipeline composition. In addition, training and fine-tuning diffusion models are also on the rise, requiring utilities that offer memory-efficient sharding,