人工性首考：面向超智能的LLM参照C-test
原标题：Artificiality's First Exam: An LLM-Referenced C-test for Supraintelligence
AI 摘要
该论文提出了一种名为 ONE 的新型 C-test，利用大语言模型作为通用图灵机来生成和认证难度可量化的逆问题测试项。测试项难度基于条件 Levin 复杂度，以比特为单位在比率尺度上衡量，可在人类或前沿模型解决之前生成高难度题目。作者构建了轻量级生成与认证流程，并对十二个 LLM 进行了测试，得到了随难度下降的智能体特征曲线，覆盖了超出当前前沿智能的超智能窗口。
正文节选
Artificiality’s First Exam: An LLM-Referenced C-test for Supraintelligence Abstract Under the accelerated pace of AI development, any benchmark whose difficulty is calibrated with humans or current AI systems becomes circular, or saturates soon. How can we then evaluate machines that may become more capable than the current machines and the people who write the tests? One answer to the question hinges on inverse problems, inductive inference questions for which difficulty depends on the complexi