微软用合成企业数据评估 Copilot 表现
原标题:From synthetic enterprise data evaluations to real Microsoft Copilot AI confidence
AI 摘要
微软研究院构建了 Industry Evaluation Data Generation Platform,通过基于 O*NET 职业数据、招聘信息和 SEC 文件等公开数据生成全规模合成企业环境,在不使用任何客户真实数据的前提下评估 Microsoft Copilot。该平台模拟真实业务流程与时间演化结构,帮助发现通用基准难以覆盖的问题,并内置安全与隐私检查,为 Copilot 建立首个标准化评估基线。
正文节选
At a glance - Evaluating Microsoft Copilot at enterprise scale requires test data that captures the full complexity of real organizations, yet real enterprise data contains sensitive information that cannot be used for evaluation under any circumstances. - To resolve this tension, we built Industry Evaluation Data Generation Platform: full-scale synthetic enterprise environments grounded in publicly available real-world data sources such as O*NET occupational data, online job postings, and SEC f