Ray 2.59.0 发布:LLM API 转正,新增外部 shuffle 与默认 token 认证
原标题:Ray-2.59.0
AI 摘要
Ray 发布 2.59.0 版本,Ray Data LLM 与 Ray Serve LLM 正式 GA/稳定,并升级至 vLLM 0.27.0。Ray Data 引入外部磁盘 shuffle(shuffle_v2)及 Join/Aggregation 支持,新增 ORC、多路径 Lance、视频读取参数等数据源能力。安全方面,本地集群默认启用 token 认证,dashboard 对 runtime_env 脱敏并修复 Hudi 读取的远程代码执行风险。Ray Serve 新增可配置背压响应、声明式 tracing 配置以及 gang 调度部署的 scale-to-zero 支持。
正文节选
**Highlights** > * **Ray Data LLM & Ray Serve LLM are GA/Stable:** the LLM APIs graduate to general availability this release (\#65194), alongside an upgrade to vLLM 0.27.0 (\#65351). > * **Ray Data external shuffle (shuffle\_v2):** the new shuffle backend gains an external, disk-backed mode — a new external shuffle runtime library and task/operator set (\#64828, \#65144), planner integration (\#65499), and Join & Aggregation support on external shuffle (\#65897). The strategy was renamed