返回全部动态

LMDeploy v0.17.0 发布:集成 DeepEPv2 并支持 Kimi K2.6

原标题:v0.17.0

LMDeploy Releases一手来源产品发布质量 81

AI 摘要

LMDeploy 发布 v0.17.0 版本,集成了 DeepEPv2,支持 Kimi K2.6 和 mooncake store,并优化了 GLM-5.2 服务性能。该版本还引入了服务端 fan-out、PDL 分页注意力、FP8 MoE 优化等改进,并修复了多个 bug。

以上摘要由 AI 生成,可能存在误差。事实请以原文为准。

正文节选

<!-- Release notes generated using configuration in .github/release.yml at main --> ## What's Changed ### 🚀 Features * Integrate DeepEPv2 by @irexyc in https://github.com/InternLM/lmdeploy/pull/4783 * feat(pytorch): support Kimi K2.6 by @qescccczmr in https://github.com/InternLM/lmdeploy/pull/4846 * feat(kv_connector): support mooncake store by @caikun-pjlab in https://github.com/InternLM/lmdeploy/pull/4903 ### 💥 Improvements * feat(chat-completions): server-side fan-out for n>1 choice


发布时间:2026-09-01 15:13
抓取时间:2026-09-01 16:15
来源机构:Shanghai AI Laboratory
阅读原文github.com