20多位顶尖AI研究者警告自动化AI研究带来极端风险
原标题:More than 20 leading AI researchers warn that automated AI research poses extreme risks
AI 摘要
包括Geoffrey Hinton、Yoshua Bengio和OpenAI研究负责人Jakub Pachocki在内的20多位顶尖AI研究者发表论文,警告自我改进的AI可能引发“智能爆炸”。论文指出,AI系统已在构建它们的公司中编写大部分代码,并可能在未来几年内自动化整个AI研发流程,使原本需要数年的进展在数月内完成。作者警告社会可能无法跟上,对超级智能AI的控制可能失控,国家、公司和政府之间的权力平衡可能被削弱,并敦促政策制定者加强对AI研究自动化过程的了解。
正文节选
More than 20 leading AI researchers warn that automated AI research poses extreme risks In case you didn't have enough, here's another AI warning: More than 20 AI researchers, including Geoffrey Hinton, Yoshua Bengio, and OpenAI research lead Jakub Pachocki, warn of a possible "intelligence explosion" driven by self-improving AI in a new research paper. "Although there remains much uncertainty, AI R&D automation might soon trigger one," they write. According to the study, AI systems already writ