返回全部动态

StreamArena:面向连续交互与长时程智能体流媒体视频理解的基准与架构

原标题:StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding

Hugging Face Daily Papers一手来源研究质量 84

AI 摘要

StreamArena是一个用于小时级、交互式流媒体视频理解的基准测试,包含243个平均时长88.8分钟的视频和3646个开放式问答对,评估实时感知、历史回顾、主动交互和多模态工具使用能力。研究发现现有方法在连续交互和长时程多模态理解之间存在矛盾,为此提出StreamMind架构,通过前端工作者处理延迟关键任务、后端工作者构建持久多模态记忆,在四项能力上均优于现有基线并降低查询响应延迟。

以上摘要由 AI 生成,可能存在误差。事实请以原文为准。

正文节选

StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding Abstract Deploying autonomous multimodal agents in continuous, real-world environments requires them to ingest unbounded audio-visual streams and maintain hour-scale memory. However, current evaluations predominantly rely on brief clips and multiple-choice formats. This design allows minimal baselines that process only the last four frames to match or surpass complex streaming models, while answer


发布时间:—
抓取时间:2026-08-10 11:06
来源机构:Hugging Face
阅读原文huggingface.co