HMHarsha Mangenainharshamangena.hashnode.dev·Apr 30 · 19 min readRouteKV Compiler: The Brain That Decides Where Your LLM's Memory LivesImagine you're running a massive LLM in production think 128K context windows, thousands of concurrent users, all hammering your GPU cluster. At some point, you notice something weird: your GPUs aren'00
HMHarsha Mangenainharshamangena.hashnode.dev·Mar 27, 2025 · 6 min readAI CLI in GOWorkflow with CodeAI CLI CodeAI CLI is a command-line tool designed to empower developers by integrating artificial intelligence capabilities directly into their development environment. Leveraging local large language models (LLMs) through the Ollam...00
HMHarsha Mangenainharshamangena.hashnode.dev·Mar 6, 2025 · 8 min readMicro LLMs: Fine-Tuning for Specific TasksIntroduction Hey there! If you've been following the AI space lately, you've probably heard about Large Language Models (LLMs) like ChatGPT, Claude, or LLaMA. These AI marvels can write essays, answer questions, and even create code. But there's a ne...00
HMHarsha Mangenainharshamangena.hashnode.dev·Feb 5, 2025 · 3 min readTools for LLM TuningTraining large language models (LLMs) can feel like trying to tame a dragon: powerful, resource-hungry, and intimidating. But with the right tools, even beginners can achieve impressive results. In this guide, we’ll explore three popular frameworks—U...00
HMHarsha Mangenainharshamangena.hashnode.dev·Feb 3, 2025 · 6 min readAdvanced Adapter Merging Strategies in LLMsIn the rapidly evolving landscape of Large Language Models (LLMs), the ability to efficiently customize and adapt these models for specific tasks has become increasingly crucial. This comprehensive guide explores two sophisticated adapter merging str...00