评估上下文协议（ECP）：AI代理评估的可移植契约
原标题：The Evaluation Context Protocol (ECP): A Portable Contract for AI Agent Evaluation
AI 摘要
本文提出评估上下文协议（ECP），一个早期、供应商中立的框架，旨在为AI代理系统提供可移植的评估契约层。ECP定义了一个JSON-RPC接口，代理通过它暴露用户可见输出、工具调用和审计上下文，并支持跨框架和CI系统的统一程序化检查。论文还提供了包含LangChain、LlamaIndex、CrewAI和PydanticAI适配器的开源参考实现，并指出该协议是进行中的工作，需进一步实证验证。
正文节选
The Evaluation Context Protocol (ECP): A Portable Contract for AI Agent Evaluation Abstract The evolution of artificial intelligence has necessitated a fundamental shift from evaluating isolated Large Language Models (LLMs) to assessing autonomous agentic architectures. This paper explores the critical methodologies for evaluating AI agents and the essential role of advanced observability infrastructure. We analyze the architectural components of agents and identify the severe limitations of cur