返回全部动态

用LLM模拟真实用户人格提升移动应用功能覆盖测试

原标题:Towards Comprehensive Mobile Application Testing for User-centric Feature Coverage via Simulating Real-World Users with Personas

arXiv cs.SE一手来源研究质量 78

AI 摘要

该论文针对LLM智能体黑盒移动应用测试中现有指标(Activity Coverage)无法衡量用户真正关心功能覆盖的问题,提出用户中心功能覆盖基准(含3,012个来自应用描述与真实评论的目标功能及LLM-as-a-judge自动评估流程),并设计ECS框架,通过探索、关键用户旅程(CUJ)与人格增强的合成评论来模拟真实用户。ECS实现64.1%功能覆盖率,较最先进基线提升23.8%,并覆盖应用描述中72.5%的功能。失败分析指出无状态性和探索可发现性是主要失败原因。

以上摘要由 AI 生成,可能存在误差。事实请以原文为准。

正文节选

Towards Comprehensive Mobile Application Testing for User-centric Feature Coverage via Simulating Real-World Users with Personas Abstract Large Language Model (LLM) agents are increasingly used for black-box mobile application testing, where the ultimate goal is the comprehensive coverage of the features users rely on. However, most existing studies focus on Activity Coverage, which measures the proportion of distinct application screens visited during a test session but does not directly measur


发布时间:2026-11-06 13:00
抓取时间:2026-11-06 15:56
来源机构:arXiv
阅读原文arxiv.org