返回全部动态

Google Cloud API Gateway 推出流式支持,面向实时与 AI 应用

原标题:Google Cloud API Gateway Introduces Streaming Support for Real-Time and AI-Powered Applications

InfoQ AI ML and Data EngineeringAPI 更新质量 66

AI 摘要

Google Cloud 宣布 API Gateway 的流式支持进入公开预览,将传统请求-响应模型扩展至实时通信场景,尤其面向流式模型响应、多步 Agent 工作流和交互式会话等 AI 应用。新功能让流式端点可在保留 API Key 校验、JWT 验证、日志监控等既有网关策略的同时运行,并引入可预测的网关主机名格式。API Gateway 还支持模型路由,通过单一 OpenAI 兼容端点按请求中的 model 字段将流量分发至 Gemini、Claude 或 OpenAI gpt-oss。评论者指出既有网关无法原地切换,且延迟指标衡量的是整个流时长而非首字节时间。

以上摘要由 AI 生成,可能存在误差。事实请以原文为准。

正文节选

Google has announced the public preview of streaming support for API Gateway, extending its traditional request-response model to support applications requiring real-time communication. According to Google, this is particularly relevant for AI applications that provide streaming model responses, multi-step agent workflows, and interactive sessions. The new functionality enables streaming endpoints to operate behind API Gateway while retaining existing gateway policies and security controls, ther


发布时间:2026-11-06 00:00
抓取时间:2026-11-06 00:16
来源机构:InfoQ
阅读原文infoq.com