Google 推出 AgentHands:为 XR 对话代理生成同步手部手势
原标题:AgentHands: Generating interactive hand gestures for spatially grounded agent conversations in XR
AI 摘要
Google Research 发布了 AgentHands,一个基于 LLM 的 XR 原型系统,通过同步的、富有表现力的手部手势为对话代理提供空间锚定的指导,以弥合心理映射差距并增强用户在物理任务中的参与度。该系统利用眼动追踪和场景重建进行对象注册,并构建了包含指示性、象形性和表达性三类手势的库,通过词级时间戳实现语音与手势的同步。在 CHI 2026 发表的研究中,用户研究(N=12)表明,与仅语音的基线相比,AgentHands 在空间接地交互中更有效。该研究由 Google XR 团队主导,Ziyi Liu 为主要研究者。
正文节选
August 25, 2026 Xun Qian, Research Scientist, and Ruofei Du, Interactive Perception & Graphics Lead, Google XR AgentHands is an LLM-powered XR prototype that augments conversational agents with synchronized, expressive hand gestures to provide spatially grounded guidance, bridging the mental mapping gap and enhancing user engagement in physical tasks. As AI assistants evolve from simple text interfaces to multimodal companions, we are seeing a shift toward more proactive, situated assistance. Re