A^2E：端到端智能体审计引擎

AI 摘要

A^2E（Agent Auditing Engine）是一个端到端的智能体评估引擎，通过标准化的任务协议（ATP）和自动插桩的监控器捕获执行轨迹，从效率、工具使用、任务规划和错误恢复等多个维度评估智能体框架的能力。实验表明，模型与框架的组合在不同任务上表现差异显著，没有单一组合能在所有任务上持续最优，这凸显了系统化评估的必要性。该研究的代码已在GitHub上开源。

正文节选

A^2E : An End-to-End Agent Auditing Engine Abstract A2E is an end-to-end evaluation engine for agent harnesses that uses a standardized task protocol and execution traces to assess capabilities across efficiency, tool use, planning, and error recovery. With the rapid advancement of large language models (LLMs), harnesses have become essential infrastructure for deploying agents across a wide range of domains. The fast-evolving harness ecosystem has also made rigorous capability evaluation increa

发布时间：—

抓取时间：2026-08-12 01:41

来源机构：Hugging Face