返回全部动态

BirdsongChat:多模态具身行为模拟的混合多智能体框架

原标题:BirdsongChat: A Hybrid Multi-Agent Framework for Multimodal Embodied Behavior Simulation

arXiv cs.MA一手来源研究质量 78

AI 摘要

研究者提出 BirdsongChat,一个混合多智能体框架,用于多模态具身行为模拟。该框架通过统一参数表示(UPR)将基于 LLM 的推理智能体与物理模拟智能体连接,把多模态输入转化为可解释的行为状态和控制参数,从而生成同步的 3D 运动、空间化声音和环境行为。原型系统以鸟类行为模拟为测试平台,在文本和图像引导场景中取得跨模态一致性 94.4%、情感一致性 100%、生成一致性 92.6% 的归一化得分,表明显式中间表示能有效桥接语义推理与物理执行。

以上摘要由 AI 生成,可能存在误差。事实请以原文为准。

正文节选

BirdsongChat: A Hybrid Multi-Agent Framework for Multimodal Embodied Behavior Simulation Abstract Multimodal embodied systems require translating human intentions into interpretable and coordinated behaviors across heterogeneous modalities. However, existing multimodal agents often rely on implicit representations, limiting controllability and cross-modal consistency. We present a hybrid multi-agent framework for interactive multimodal behavior simulation that bridges semantic reasoning and phys


发布时间:2026-09-21 12:00
抓取时间:2026-09-21 12:52
来源机构:arXiv
阅读原文arxiv.org