Skip to content
AIBRAINWORX / OpenSourceCoder.comLOCAL-FIRST. BUILT IN THE OPEN.
Inference & Quantization / Infrastructure & Data / Inference & Hardware / Models & Weights

DeepSeek releases DeepInfer offline inference engine under Apache 2.0

Supporting both NVIDIA SM100 (Blackwell) GPUs and Huawei Ascend 950 NPUs, DeepInfer opens the batch engine behind DeepSeek-V4.1-Flash.

Listen to this articleBrowser Voice
Ready
Official DeepSeek repository icon
AI-generated conceptual illustration by AiBrainWorX; not a photograph or product screenshot. · DeepSeek mark; identification only, no endorsement.
Event / context: DeepSeek open-sourced DeepInfer in November 2026.. Source check: October 28, 2026.

DeepSeek's DeepInfer is now open source under the Apache 2.0 license, exposing the custom FlashMLA, DeepGEMM, and DeepEP kernels behind DeepSeek-V4.1-Flash serving.

Multi-vendor kernels, offline scope

DeepInfer targets NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs with asynchronous batching, grammar-constrained outputs, and DSpark speculative decoding. Out of the box, it is an offline batch engine—developers deploying online web APIs must add their own HTTP server, KV-cache disaggregation, and load balancing.

Original reporting; primary project releases reviewed November 16, 2026. No independent hands-on benchmark claimed.

Follow your curiosity.

Pass the signal.