Sequent成立：AI对齐研究新组织，聚焦超级智能安全
原标题：Import AI 461: "Alignment is not on track"; FrontierCode; and synthetic research interns
AI 摘要
英国AI安全研究所对齐团队和Timaeus的研究人员联合成立了非营利研究组织Sequent，旨在开发对齐技术，以确保超级智能AI系统的安全性。Sequent计划在几年内招聘40-80名员工，并筹集1亿至1.5亿美元初始资金，同时探索多个对齐研究方向，如可扩展监督、学习理论和博弈论。该组织认为当前AI实验室的对齐方法本质上是反应性的，无法提供先验信心，因此需要更主动的研究。
正文节选
Import AI 461: "Alignment is not on track"; FrontierCode; and synthetic research interns Where are your agents right now? Welcome to Import AI, a newsletter about AI research. Import AI runs on arXiv, cappuccinos, and feedback from readers. If you’d like to support this, please subscribe. AI researchers launch new safety startup because “alignment is not on track”: …Sequent will have a portfolio of under-resourced research bets… Researchers from the UK AI Security Institute Alignment team as wel