OpenAI自研芯片Jalapeño基准测试超越Nvidia Blackwell和Rubin
原标题:OpenAI's first custom chip "Jalapeño" reportedly beats Nvidia's Blackwell and Rubin in inference benchmarks
AI 摘要
OpenAI在Hot Chips大会上展示了其首款自研推理芯片“Jalapeño”的基准测试结果,声称其在每瓦吞吐量和token延迟上优于Nvidia的Blackwell和Rubin芯片。该芯片由OpenAI与博通合作开发,历时约16个月,其中设计周期仅9个月,并使用了OpenAI自身的模型辅助设计。SemiAnalysis的测试显示,Jalapeño在性能功耗比上大幅领先,但尚未量产,且未采用多token预测等优化技术。
正文节选
OpenAI's first custom chip "Jalapeño" reportedly beats Nvidia's Blackwell and Rubin in inference benchmarks OpenAI showed off the first benchmarks for its in-house inference chip at the Hot Chips conference. "Jalapeño" reportedly outperforms both Nvidia's Blackwell and Rubin in throughput per watt and token latency. The chip handles inference only, meaning it runs AI models but doesn't train them. Jalapeño isn't tuned to OpenAI's own models either. It's a general-purpose LLM inference accelerato