H2R-Bench:评估人类到机器人操作视频生成的基准
原标题:H2R-Bench: Benchmarking Human-to-Robot Manipulation Video Generation in World Models
AI 摘要
H2R-Bench是一个用于评估视频生成模型将人类操作视频转换为机器人中心演示的基准,涵盖跨具身约束和交互保真度。该基准包含人类演示视频、目标具身约束和源接地注释,通过五个维度评估生成视频。研究团队对11个最先进的视频生成模型在六个操作家族和两个机器人具身上进行了基准测试,发现当前视频世界模型在人类到机器人操作转移方面仍存在局限,即使在具身一致性、功能交互和任务执行方面也常失败。H2R-Bench提供了一个系统诊断框架,用于评估视频世界模型能否弥合人类到机器人的具身差距。
正文节选
H2R-Bench: Benchmarking Human-to-Robot Manipulation Video Generation in World Models Abstract H2R-Bench evaluates video generation models on transforming human manipulation videos into robot-centric demonstrations across embodiment constraints and interaction fidelity. Large-scale manipulation data is essential for robot learning, yet collecting robot demonstrations remains expensive and difficult to scale. Meanwhile, abundant egocentric human manipulation videos provide rich behavioral experien