DeepInfer
DeepSeek announced on Oct. 20 that it had open‑sourced the inference framework DeepInfer. DeepInfer currently supports the DeepSeek-V4.1-Flash model. DeepInfer supports NVIDIA SM100 graphics processors. DeepInfer supports Huawei Ascend 950 chips. DeepInfer is based on the vLLM framework DeepInfer is released under the Apache License 2.0 DeepSeek released DeepInfer DeepInfer runs on NVIDIA DeepInfer runs on Huawei Ascend platform DeepInfer supports SWA Bounded Replay DeepInfer uses deepseek-recipe component DeepInfer runs on SM100/A950 card DeepInfer is the inference engine behind V4.1 Flash DeepInfer CUSTOMIZED_WITH SGLang DeepInfer CUSTOMIZED_WITH TRRTLLM DeepInfer SUPPORTS NVIDIA DeepInfer SUPPORTS Huawei Ascend DeepInfer COMPARES_WITH OpenAI· Entity summary generated by Graphiti
Relation timeline
BY VALID-FROM DATE- DeepInferRUNS ONNVIDIA
DeepInfer runs on NVIDIA
- DeepInferRUNS ONHuawei Ascend 950 chips
DeepInfer runs on Huawei Ascend platform
- DeepInferCUSTOMIZED WITHSGLang
DeepInfer CUSTOMIZED_WITH SGLang
- DeepInferUSESdeepseek-recipe
DeepInfer uses deepseek-recipe component
- DeepInferRELATES TODeepseek V4.1-Flash
DeepInfer is the inference engine behind V4.1 Flash
- DeepInferSUPPORTSNVIDIA
DeepInfer SUPPORTS NVIDIA
- DeepInferCOMPARES WITHOpenAI
DeepInfer COMPARES_WITH OpenAI
- DeepInferSUPPORTSHuawei Ascend 950 chips
DeepInfer SUPPORTS Huawei Ascend
- DeepInferCUSTOMIZED WITHTRRTLLM
DeepInfer CUSTOMIZED_WITH TRRTLLM
- DeepseekRELEASEDDeepInfer
DeepSeek released DeepInfer
- DeepInferRUNS ONNVIDIA SM100 graphics processors
DeepInfer runs on SM100/A950 card
- DeepInferSUPPORTSFlashInfer
DeepInfer supports SWA Bounded Replay
- DeepInferRELEASED UNDER LICENSEDeepseek V4.1-Flash-1017
DeepInfer is released under the Apache License 2.0
- DeepInferBUILDS ONvLLM
DeepInfer is based on the vLLM framework
- DeepInferSUPPORTSNVIDIA SM100 graphics processors
DeepInfer supports NVIDIA SM100 graphics processors.
- DeepseekRELEASEDDeepInfer
DeepSeek announced on Oct. 20 that it had open‑sourced the inference framework DeepInfer.
- DeepInferSUPPORTSDeepseek V4.1-Flash
DeepInfer currently supports the DeepSeek-V4.1-Flash model.
- DeepInferSUPPORTSHuawei Ascend 950 chips
DeepInfer supports Huawei Ascend 950 chips.
Relations are facts Graphiti extracted from reports, not verbatim quotes. An end date means later reporting showed the relation no longer holds.
Events 3
- [AINews] DeepSeek DeepInfer: Open Source SOTA Inference running 155T toks/day/cluster making $22m/day at ~80% margin for a 81 day payback1 cited report · 2026-10-21
- US orders DeepSeek purge from federal systems as Chinese AI rival opens its technology to the world1 cited report · 2026-10-21
- Deepseek open-sources the inference engine that powers its fastest and cheapest AI model1 cited report · 2026-10-21
Source reports 3
- [AINews] DeepSeek DeepInfer: Open Source SOTA Inference running 155T toks/day/cluster making $22m/day at ~80% margin for a 81 day paybackLatent Space · 2026-10-21
- US orders DeepSeek purge from federal systems as Chinese AI rival opens its technology to the worldCryptoSlate · 2026-10-21
- Deepseek open-sources the inference engine that powers its fastest and cheapest AI modelThe Decoder · 2026-10-21