Anthropic 警告接近递归自我改进能力
原标题:Anthropic warns that it’s very close to RSI capability, aka self-building AI
AI 摘要
Anthropic 在修订后的 S-1A 文件中警告,公司可能即将达到其 Responsible Scaling Policy 所定义的「递归自我改进(RSI)」门槛,即 AI 能显著加速自身研发。文件称,公司过去曾未及时识别模型能力的跃升,未来也可能如此,但目前尚无模型越过该门槛,并承诺在可预见未来保持人类对前沿模型开发的监督。此举将 RSI 从争议概念推向正式披露的风险因素,引发对 AI 安全治理的讨论。
正文节选
While much attention has focused on the updated financials Anthropic revealed in its revised S-1A on Monday, (revenue is soaring, but so are expenses), the AI lab dropped another little bombshell in the fine print. The filing seems to warn that the company is on the cusp of creating a model capable of recursive self-improvement (RSI). RSI is the point at which AI grows so good at training itself that it spawns a dramatic acceleration of AI capabilities. To the AI doomers, RSI represents the cata