模型还是框架?交互中心分类法定位智能体失败
原标题:Model or Harness? An Interaction-Centric Taxonomy for Localizing Agent Failures
AI 摘要
Hugging Face 每日论文介绍了一项关于智能体失败定位的新研究。该研究提出了一种以交互为中心的失败分类法,将41种失败模式分配到智能体系统组件间的交互边上,并指明修复责任方(模型、框架、环境或评估器)。该分类法通过公开基准、系统卡片和智能体轨迹进行验证,并使用独立推理智能体评估其可复现性,最强评判者与人类标签的Cohen's κ达到0.76。
正文节选
Model or Harness? An Interaction-Centric Taxonomy for Localizing Agent Failures Abstract Existing evaluations often reduce agent failures to system-level outcomes, obscuring where the fault originated and which intervention would improve the agent system. This creates a repair-assignment problem: the same visible failure may call for model post-training, harness engineering, environment redesign, or benchmark repair depending on its source. Because agent behavior emerges from interactions among