NVIDIA GPU 加速 OpenAI GPT-6 Astra Ultrafast
原标题:How NVIDIA GPUs Help Accelerate OpenAI’s GPT-6 Astra Ultrafast
AI 摘要
OpenAI 在 NVIDIA Blackwell GPU 上推出 GPT-6 Astra Ultrafast,现已通过 OpenAI API 以及面向符合条件的 ChatGPT Work 和 Codex 用户开放。该模式借助针对 Blackwell 架构的推理优化,token 生成速度最高可达 Astra Standard 模式的 8 倍,可缩短编码智能体的编辑-测试-调试周期并提升交互应用响应速度。OpenAI 还利用自身模型优化 NVIDIA GPU 上的推理软件,以持续提升性能。
正文节选
GPT-6 Astra Ultrafast, running on NVIDIA Blackwell GPUs, is available now in the OpenAI API and to eligible ChatGPT Work and Codex users. Accelerated by inference optimizations through OpenAI’s models that tap into the capabilities of the NVIDIA Blackwell architecture, Ultrafast offers up to 8x faster token generation than the Astra Standard mode. For developers, faster generation can shorten coding agents’ edit-test-debug cycles, reduce the time spent generating responses between tool calls and