返回全部动态

模型还是框架?交互中心分类法定位智能体失败

原标题:Model or Harness? An Interaction-Centric Taxonomy for Localizing Agent Failures

Hugging Face Daily Papers一手来源研究质量 84

AI 摘要

Hugging Face 每日论文介绍了一项关于智能体失败定位的新研究。该研究提出了一种以交互为中心的失败分类法,将41种失败模式分配到智能体系统组件间的交互边上,并指明修复责任方(模型、框架、环境或评估器)。该分类法通过公开基准、系统卡片和智能体轨迹进行验证,并使用独立推理智能体评估其可复现性,最强评判者与人类标签的Cohen's κ达到0.76。

以上摘要由 AI 生成,可能存在误差。事实请以原文为准。

正文节选

Model or Harness? An Interaction-Centric Taxonomy for Localizing Agent Failures Abstract Existing evaluations often reduce agent failures to system-level outcomes, obscuring where the fault originated and which intervention would improve the agent system. This creates a repair-assignment problem: the same visible failure may call for model post-training, harness engineering, environment redesign, or benchmark repair depending on its source. Because agent behavior emerges from interactions among


发布时间:—
抓取时间:2026-08-04 20:38
来源机构:Hugging Face
阅读原文huggingface.co