返回全部动态

Deepseek 开源其最快最便宜模型的推理引擎

原标题:Deepseek open-sources the inference engine that powers its fastest and cheapest AI model

THE DECODER开源质量 61

AI 摘要

Deepseek 以 Apache License 2.0 协议开源了其内部推理框架 DeepInfer,该框架基于 vLLM 构建,包含优化的计算内核、多芯片分布式处理和更快的文本生成技术,用于支撑其 V4.1-Flash 模型的高效推理服务。Deepseek 同时发布了 deepseek-recipe,用于复现官方 API 的 token 处理流程,使自托管部署行为一致。公司称此举旨在帮助社区降低算力成本与能耗,但报道指出这也会对 OpenAI、Anthropic 等西方厂商形成价格压力。

以上摘要由 AI 生成,可能存在误差。事实请以原文为准。

正文节选

Deepseek open-sources the inference engine that powers its fastest and cheapest AI model Deepseek has open-sourced DeepInfer, its internal inference framework, under the Apache License 2.0. Inference is how a trained AI model handles requests and generates responses. DeepInfer is the serving software that lets Deepseek's V4.1-Flash model produce answers quickly at scale. The framework builds on vLLM with optimized compute kernels, distributed processing across multiple chips, and faster text gen


发布时间:2026-10-21 02:56
抓取时间:2026-10-21 03:47
来源机构:THE DECODER
阅读原文the-decoder.com