MMmao maoinmaomao.hashnode.dev·Dec 10, 2025 · 3 min readThe KV Cache Dilemma: Why LLM Inference Needs to "Forget" to Scale?Have you ever wondered why the 10th turn of a conversation with an LLM feels just as fast as the first? Mathematically, this shouldn’t happen. As the context grows (History + New Question), the computation required to generate the next token should i...00
MMmao maoinmaomao.hashnode.dev·Nov 3, 2025 · 7 min readHow to Build MCP AI Model Conversion Server: A Complete GuidePurposeBuild a reusable service that takes only a Hugging Face model_id (plus optional tuning parameters) and produces optimized artifacts for multiple deployment targets. The service should be usable by humans, agents, or external tools (VS Code, Cl...00
