HPCAgent-Bench：代码优化智能体的可靠基准框架
原标题：HPCAgent-Bench: A Framework for Sound Benchmarking of Code-Optimizing Agents, Harnesses, and Skills
AI 摘要
研究者提出 HPCAgent-Bench，一个用于评估代码优化智能体、工具链与技能的开源基准框架，包含 689 个内核，覆盖循环级优化、HPC 代码和机器学习模型三个赛道。框架用 NumPy 统一指定内核并派生 C/Fortran 参考实现，通过外部裁判在隐藏模糊输入上校验正确性并计时，防止智能体作弊。作者还提出干预效能和加权 token 成本两项指标，用于归因工具或技能带来的加速与成本变化。
正文节选
HPCAgent-Bench: A Framework for Sound Benchmarking of Code-Optimizing Agents, Harnesses, and Skills Abstract Coding agents are increasingly used to optimize code, but existing benchmarks fix one accelerator, programming model or harness, so they cannot isolate what each component contributes or show whether added skills and tools repay their cost. We present HPCAgent-Bench with 689 kernels in three tracks: loop-level optimization challenges, kernels extracted from HPC codes, and machine-learning