NVIDIA Nemotron 3.5 Lightning 登陆 SageMaker JumpStart
原标题:NVIDIA Nemotron 3.5 Lightning now available in Amazon SageMaker JumpStart
AI 摘要
AWS 宣布 NVIDIA Nemotron 3.5 Lightning 模型现已在 Amazon SageMaker JumpStart 上提供,该模型专为高容量代理工作负载设计,采用混合 MoE 架构,总参数 30B 但仅激活 3B,支持高达 1M 上下文长度,吞吐量提升 4 倍,任务完成速度提升 30%。用户可通过 SageMaker JumpStart 直接部署,无需手动配置服务基础设施,并可基于 NVIDIA NeMo 进行定制。
正文节选
NVIDIA Nemotron 3.5 Lightning now available in Amazon SageMaker JumpStart NVIDIA Nemotron 3.5 Lightning is designed for the fast, specialized model execution required by high-volume agentic workloads. With NVIDIA Nemotron 3.5 Lightning on Amazon SageMaker JumpStart, you can access an open model designed for high-volume agentic workloads. With this launch, you can deploy Nemotron 3.5 Lightning from Amazon SageMaker JumpStart without configuring the serving infrastructure yourself. NVIDIA describe