DeskForge：面向计算机使用代理的桌面环境密集监督
原标题：DeskForge: Dense Supervision from Desktop Environments for Computer-Use Agents
AI 摘要
研究者提出 DeskForge，一个可控的 Linux 桌面环境，通过组合真实应用并系统变化应用状态、内容、窗口布局、外观和分辨率，融合截图、无障碍树和窗口几何信息生成密集元素标注。基于此构建了包含 120 万条桌面观测、1.597 亿元素实例的 DeskForge-1M 数据集，并在 20 万条 grounding 样本上微调四个视觉语言模型。结果显示所有模型在留出桌面条件和五个外部 GUI grounding 基准上均有提升，Qwen3.5-4B 在 ScreenSpot-Pro 上提升 11.51 个百分点，长程任务完成数也显著增加。
正文节选
DeskForge: Dense Supervision From Desktop Environments for Computer-use agents Abstract Computer-use agents need to reliably ground action targets in complex desktop scenes, where multiple applications, overlapping windows, and visually similar controls compete for attention. Existing training data rarely pair such scenes with dense annotations or vary them in a controlled way. We introduce DeskForge, a controllable desktop environment that composes and explores real applications to generate la