DeepSeek open-sourced its inference engine. The three parts it left out are the real system design.

Near the top of the DeepInfer README there is a short list with a plain heading: "Required for a complete inference service (not included in this release)". It has three items. A KV cache system. "VE/