Cloudflare 优化 AI 代码审查器,推理成本降低 68%
原标题:Cutting our inference bill by 68% by being obsessive about optimization
AI 摘要
Cloudflare 通过优化 AI 代码审查器,将平均审查成本从 2.43 美元降至 0.77 美元,降幅 68%,中位审查时间从 4 分 09 秒缩短至 1 分 32 秒。成本上涨主要源于模型切换(全面改用 Anthropic 模型)和 token 用量激增(每次审查 token 数从 91 万增至 299 万)。约 40% 的节省来自代码优化,其余来自模型选择与推理强度调整。
正文节选
When we previously blogged about our AI code reviewer in April, an average review cost a palatable $1.19. By the end of August, that figure had shot up to about $2.46. We hadn't made any significant architectural changes: the coordinator was still handing work to the same set of specialist reviewers, and the same risk tiers decided how intensive of a review we gave. Around mid-September we tasked our agents with working out where those tokens were going and cutting them — aggressively. With code