返回全部动态

CogAdapt:认知信号引导的代码大模型稀疏适配

原标题:CogAdapt: Cognition-informed Sparse Adaptation of Code LLMs

arXiv cs.SE一手来源研究质量 82

AI 摘要

研究提出 CogAdapt 框架,利用人类阅读代码时的脑电(EEG)和眼动注意力数据学习程序级与 token 级先验,再结合冻结模型对任务的响应,决定微调时更新哪些 transformer 块及分配多少适配量。在 Qwen 和 GLM 上,该方法在 LiveCodeBench 和 BigCodeBench 上取得最佳 pass@1,相比常规微调在 LiveCodeBench 上提升 10.86 和 6.29 个百分点,同时将可梯度更新的适配参数减少 86.21–87.21%。

以上摘要由 AI 生成,可能存在误差。事实请以原文为准。

正文节选

CogAdapt: Cognition-informed Sparse Adaptation of Code LLMs Abstract. Large language models (LLMs) have become increasingly capable of generating code. However, achieving stronger code-generation performance still often relies on costly model adaptation, i.e., fine-tuning pretrained model parameters. Meanwhile, prior studies have shown meaningful correspondence between how humans process code and how neural models allocate attention or internal computation. Building on this relationship, recent


发布时间:2026-10-07 12:00
抓取时间:2026-10-07 13:30
来源机构:arXiv
阅读原文arxiv.org