ZGCM-1:面向数学与智能体搜索的全开源高效 7B 基础模型
原标题:Paper page - ZGCM-1: A Fully Open and Extremely Efficient Foundation Model for Math and Agentic Search
AI 摘要
研究团队发布 ZGCM-1,一个完全开源的 7B 稠密基础模型,从零训练,结合内部推理与外部工具使用,支持 256K 上下文。该模型采用架构与系统协同设计(交错门控滑窗与全注意力、稳定的 FP8 Muon 优化器)、渐进式课程与 MDP 中期训练,并借助智能体集群自主管理集群运维、数据整理与评估。在数学推理和智能体搜索任务上,其表现可与 Qwen3-235B-A22B、GLM-5.1 等大数十倍的前沿模型竞争,16K 预训练时间到损失效率提升约 4.2 倍,并开源权重、训练代码、数据与日志。
正文节选
ZGCM-1: A Fully Open and Extremely Efficient Foundation Model for Math and Agentic Search Abstract ZGCM-1 is a 7B open foundation model that combines internal reasoning with external tool use, trained via efficient architecture-system co-design, progressive long-context scaling, and autonomous agent workflows to achieve strong reasoning and efficiency. In this work, we present ZGCM-1, a fully open 7B dense foundation model trained from scratch with extreme data, system, and algorithmic efficienc