NMNicholai Mitchkoinblog.n.ichol.ai·2h ago · 16 min readPackaging Latent Reasoning as a Real ModelDeepSeek-V4-Flash-0731-Latent-Reasoning. A self-contained model that does thinking in latent space, NVFP4-quantized, with a production vllm form for serving runtime. https://huggingface.co/nmitchko/De00
NMNicholai Mitchkoinblog.n.ichol.ai·Jul 17 · 12 min readThe Doctor is NOT the MotherAdding a CoLaR Head to DeepSeek Flash v4 for Latent Reasoning with Learned Stop Criteria Published on blog.n.ichol.ai The Riddle A father and his son are driving down the road. They crash. Only the 10
NMNicholai Mitchkoinblog.n.ichol.ai·Mar 31 · 5 min readLLM Activation Engineering: An Easy ForayThis is a recap of an old project from May 2024. Credit to Neel Nanda for llm lens and Mihaiiii for llm steer python modules. I've been playing around with steering LLM outputs by manipulating their 20
