Matrix-Game 4.0:用视频模型打造实时可玩游戏世界
原标题:Paper page - Matrix-Game 4.0: Harnessing Video Models for Real-Time Playable Game Worlds
AI 摘要
研究团队发布 Matrix-Game 4.0,将游戏逻辑与视觉合成分离:轻量游戏引擎维护世界状态并执行交互规则,多模态编码智能体把玩家想法转成游戏代码与动态场景描述,自回归视频渲染器将低多边形代理画面转为高保真视觉。系统在单张 NVIDIA RTX5090 上实现 480p、60 FPS 实时游玩,按键到显示延迟 112ms,并开源代码、模型权重与低多边形游戏素材。
正文节选
Matrix-Game 4.0: Harnessing Video Models for Real-Time Playable Game Worlds Abstract Matrix-Game 4.0 separates game logic from visual synthesis via an executable engine and autoregressive video renderer, achieving real-time interactive gameplay with low latency. Moving from controllable videos to genuinely playable worlds requires persistent world state, executable game rules, and low-latency interaction. We outline a roadmap for the next generation of Matrix-Game that separates game execution f