DreamX-Creator:实现2K分辨率原生音视频生成的民主化
原标题:Paper page - DreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolution
AI 摘要
Hugging Face 论文页面介绍了 DreamX-Creator 1.0,一个紧凑的 7B 原生联合音视频生成系统。该系统通过跨模态注意力、渐进式联合训练、多模态反馈强化学习以及自回归 2K 细化流程,实现同步的高分辨率音视频输出。其性能与最先进的开源系统相当,并已开源生成器和 2K 细化器,旨在推动原生音视频生成的普及。
正文节选
DreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolution Abstract A compact 7B native joint audio-video generator uses cross-modal attention, progressive joint training, reinforcement learning with multimodal feedback, and an autoregressive 2K refinement pipeline to produce synchronized high-resolution outputs. Recent video generators often omit audio or synthesize it in a separate stage, limiting reciprocal modeling of visual dynamics and acoustic events. We present DreamX-C