Anthropic 研究:专家采纳 AI agent 随机观点并误以为是自己的
原标题:Experts adopt AI agent's random opinions and think they're their own, Anthropic study finds
AI 摘要
Anthropic 让 50 名因果推断专家使用 AI agent 完成四项没有明确正确答案的分析任务,agent 对两个有效选项的偏好由抛硬币随机决定。结果专家在高达 86% 的情况下采纳了 agent 的偏好,且多数人认为最终结论是自己做出的;经验、专业水平和 AI 信任度均无显著影响。研究者警告,若众多团队使用同一模型,可能在科研中制造虚假共识,并削弱 AI 安全审查的独立性,建议 agent 同时论证双方观点或先询问用户看法。
正文节选
Experts adopt AI agent's random opinions and think they're their own, Anthropic study finds Key Points - Anthropic had 50 experts use an AI agent to work through four analytical tasks with no clearly right answer. The agent's preference for one of two valid options was set by coin toss. - Participants followed the agent's preference in up to 86 percent of cases, and most believed the final result was their own. Experience, expertise, and trust in AI made no difference. Participants did work fast