返回全部动态

SemiAnalysis 发布 GDPx 真实工作基准,AI 智能体最高仅得 12%

原标题:No AI agent scores above 12 percent on SemiAnalysis' new real-world work benchmark

THE DECODER研究质量 70

AI 摘要

分析机构 SemiAnalysis 发布 GDPx 基准,用 206 个跨 11 个领域的真实工作任务测试 AI 智能体,任务需在专业软件中持续数小时。结果显示所有模型得分均不超过 12%,Claude Opus 5.5 以 12% 领先,Gemini 4 Carbon 以 10.9% 紧随且成本约为三分之一,GPT-6 Astra 为 9.6%。批评者指出安全过滤器扭曲排名、测试任务不公开、各模型使用自家智能体软件导致条件不平等,开发者 Josh Purtell 称其“噪音多于信号”。

以上摘要由 AI 生成,可能存在误差。事实请以原文为准。

正文节选

No AI agent scores above 12 percent on SemiAnalysis' new real-world work benchmark Key Points - Analytics firm SemiAnalysis has released GDPx, a benchmark that tests AI agents on 206 tasks in realistic work environments and professional software over several hours. - The scores are low. Claude Opus 5.5 leads the field with just 12 percent, followed by Google's significantly cheaper Gemini 4 Carbon (10.9 percent) and GPT-6 Astra (9.6 percent). - Critics flag distortions from safety filters, the s


发布时间:2026-11-06 00:46
抓取时间:2026-11-06 01:14
来源机构:THE DECODER
阅读原文the-decoder.com