AWS 推出 Ray Serve 深度学习容器，简化 TorchServe 推理工作负载
原标题：Simplify and support your TorchServe workloads using Ray Serve Deep Learning Containers
AI 摘要
AWS 发布了 Ray Serve 深度学习容器（DLC），用于替代不再维护的 TorchServe，提供预构建、优化的推理镜像。该容器集成了 PyTorch、Ray Serve、CUDA 等组件，并支持在 Amazon EKS 上部署视觉语言模型（如 Qwen3-VL-2B）。文章详细介绍了部署步骤和架构，旨在简化模型推理的依赖管理和安全补丁更新。
正文节选
Simplify and support your TorchServe workloads using Ray Serve Deep Learning Containers TorchServe is no longer actively maintained. The official project notice states there are no planned updates, bug fixes, new features, or security patches, and that vulnerabilities might not be addressed. For teams that run model inference on TorchServe today, this means security patches stop and compatibility updates with newer versions of PyTorch and CUDA stop. Engineers are left owning the entire dependenc