返回全部动态

自适应奖励路由:联合音视频扩散的前向过程RL多奖励优化

原标题:Paper page - Adaptive Reward Routing: Dynamic Multi-Reward Optimization for Joint Audio-Video Diffusion via Forward-Process RL

Hugging Face Daily Papers一手来源研究质量 79

AI 摘要

该论文提出自适应奖励路由(Adaptive Reward Routing)方法,用于联合音视频扩散模型的前向过程强化学习(DiffusionNFT)。方法包含两个组件:跨模态影响引导路由,利用双向交叉注意力响应动态调整更新位置;偏好保持的模态感知重加权,在预热后以分支特定奖励梯度交互作为残差修正来协调多奖励冲突。实验表明该方法在模态质量、语义一致性和音视频同步上优于强RL基线。

以上摘要由 AI 生成,可能存在误差。事实请以原文为准。

正文节选

Adaptive Reward Routing: Dynamic Multi-Reward Optimization for Joint Audio-Video Diffusion via Forward-Process RL Abstract Multi-reward guided reinforcement learning (i.e., RL) offers a promising way to improve joint audio-video diffusion models along several complementary objectives, including modality-specific quality, cross-modal semantic alignment, and temporal synchronization. Its effectiveness, however, depends on two quantities that change during training: where reward-driven updates shou


发布时间:—
抓取时间:2026-10-02 12:28
来源机构:Hugging Face
阅读原文huggingface.co