返回全部动态

Google 发布 Android Bench 2.0,新增长周期任务与智能体评估

原标题:Android Bench 2 Adds Support for Long-Horizon Tasks, Agentic Evaluation, and Continuous Scoring

InfoQ AI ML and Data Engineering研究质量 69

AI 摘要

Google 发布 Android Bench 2.0,为其 Android 开发任务评测框架引入长周期任务(LHT)、基于智能体的评估和连续评分机制。新版本从二元通过/失败改为按功能、视觉保真度和回归情况计算完成率,并对偏离评估指令施加扣分。Google 表示 AI 更擅长编写新代码而非重构既有代码,跨平台应用移植到 Android 仍是开放挑战,最佳模型完成率仅 80%。榜单中 Claude Opus 5.5 以 32% 的 LHT 通过率居首,GPT 6 Astra 为 28%。

以上摘要由 AI 生成,可能存在误差。事实请以原文为准。

正文节选

Google has released Android Bench 2.0, a major update to its benchmark framework for evaluating AI models and agents on Android development tasks. The update introduces long-horizon tasks (LHTs), agent-based evaluation, and continuous scoring to better assess performance on complex, multi-step development tasks. Launched a few months ago, Android Bench evaluates AI models against a set of common development tasks, incorporating Android best practices in areas such as permissions, navigation, and


发布时间:2026-10-10 01:00
抓取时间:2026-10-10 01:55
来源机构:InfoQ
阅读原文infoq.com