SSSwarit Shuklainswaritshukla.hashnode.dev·Sep 22 · 5 min readGRPO: How Language Models Learn to ReasonDo you remember the times when we used to make LLMs count the occurrence of a specific letter in a word, like "How many r's in strawberry?" Back then, LLMs used to get it wrong a lot of times, but now00
SSSwarit Shuklainswaritshukla.hashnode.dev·Jul 22 · 4 min readBatch Size and LLM Inference EfficiencyHaving an optimal Batch size can decrease your models cost per token at the time of inference. This will be an explanation on how Batch size affects the cost at the inference, We will be going deep an21K
SSSwarit Shuklainswaritshukla.hashnode.dev·May 4 · 7 min readNvidia Vs Everyone: Why everyone is building their own acceleratorsThere has been a race in the AI industry where companies are now preferring their own custom accelerators to train AI models and generate inference from them. But why? Why all of a sudden is everyone 20
SSSwarit Shuklainswaritshukla.hashnode.dev·Apr 12 · 5 min readThe Elegance of MoE: How Gemma 4’s 26B Model Runs Like a 4B ModelGoogle recently dropped its new family of open-source AI models, Gemma 4, but the variant that truly captured my interest is Gemma-4-26B-A4B-IT. The question is: how can a 26 billion parameter model o40
