Packaging Latent Reasoning as a Real ModelDeepSeek-V4-Flash-0731-Latent-Reasoning. A self-contained model that does thinking in latent space, NVFP4-quantized, with a production vllm form for serving runtime. https://huggingface.co/nmitchko/DeAug 6 · 12 min readblog.n.ichol.ai
The Doctor is NOT the MotherAdding a CoLaR Head to DeepSeek Flash v4 for Latent Reasoning with Learned Stop Criteria Published on blog.n.ichol.ai The Riddle A father and his son are driving down the road. They crash. Only the 1Jul 17 · 12 min readblog.n.ichol.ai
LLM Activation Engineering: An Easy ForayThis is a recap of an old project from May 2024. Credit to Neel Nanda for llm lens and Mihaiiii for llm steer python modules. I've been playing around with steering LLM outputs by manipulating their 2Mar 31 · 5 min readblog.n.ichol.ai
