Vidu S2:实时交互、可编辑与空间视频生成
原标题:Paper page - Vidu S2: Real-Time Interactive, Editable, and Spatial Video Generation
AI 摘要
Vidu S2 发布,包含实时交互数字人模型 Vidu S2-Avatar 和实时视频编辑模型 Vidu S2-Editing,并探索了实时空间视频生成。相比 Vidu S1,Avatar 支持 720p 实时生成、动态参考图随时更新和更强的指令跟随(如跳舞),Editing 支持风格渲染、换装、换角色和换背景等实时流编辑。实验显示其在五个公开基准上均取得 SOTA,并提供在线 demo 与 API。
正文节选
Vidu S2: Real-Time Interactive, Editable, and Spatial Video Generation Abstract Vidu S2 introduces real-time interactive avatar and video editing models that support high-resolution spatial video generation and dynamic reference updates. We present Vidu S2, which comprises Vidu S2-Avatar, a real-time interactive digital-character model, and Vidu S2-Editing, a real-time video editing model. Moreover, we explore the feasibility of real-time spatial video generation for both Vidu S2-Avatar and Vidu