返回全部动态

Transformers 发布 v5.20.2 补丁版本

原标题:Patch release v5.20.2

Transformers Releases一手来源开源质量 66

AI 摘要

Hugging Face Transformers 发布 v5.20.2 补丁版本,修复了 generate 中 prepare_inputs_for_generation 可能导致输入丢失原始类型、进而影响多模态模型的问题。同时修复了 bfloat16 下专家并行且 ep_size 小于 fsdp_size 时专家梯度为零的问题,并声明仅报告文本的 VLM 的输入模态、避免 eager_mask 中的主机到设备拷贝。

以上摘要由 AI 生成,可能存在误差。事实请以原文为准。

正文节选

# Patch release: v5.20.2 This patch notably solves an issue where some inputs could loose their original type inside `prepare_inputs_for_generation` in `generate`, leading to problems with multimodal models. It also fixes some other issues listed on the below commits. It contains the following commits: - Fix inputs dict casting in generate (#49731) by @Cyrilvallez - Fix zero expert gradients in bfloat16 with expert parallelism and ep_size < fsdp_size (#49688) by @qgallouedec - Declar


发布时间:2026-10-20 01:45
抓取时间:2026-10-20 01:51
来源机构:Hugging Face
阅读原文github.com