AMAdit Modiinaditmodi.hashnode.dev·5d ago · 32 min readThe GPU Cluster You've Always Wanted: A Deep Dive into SageMaker HyperPod on EKSYou've been running Kubernetes long enough to know what it's good at. You've also hit the wall that every ML team hits when they try to run serious distributed training on it. HyperPod on EKS is AWS's00
AMAdit Modiinaditmodi.hashnode.dev·6d ago · 20 min readThe Missing Layer in Your AI Inference StackYou have vLLM running. You have Kubernetes. You have Karpenter. And yet, the moment you try to serve multiple models across multiple clusters, you're writing glue code that no one else can see or bene00
AMAdit Modiinaditmodi.hashnode.dev·6d ago · 14 min readContainers Weren't Built for AgentsI've spent years running containers on Kubernetes. EKS clusters, GPU workloads, Karpenter node pools — the whole stack. The mental model was stable: a container is a process with namespace isolation, 00
AMAdit Modiincloudtech.hashnode.dev·Jun 27 · 18 min read👋 Everything about EKS & AI Infrastructure Newsletter "#74" ☁️❤👨💻Dear EKS & AI Infrastructure enthusiasts, Welcome to Everything about EKS & AI Infrastructure #74. There’s a thread running through this edition, and it’s unglamorous: most of what makes AI infrastruc00
AMAdit Modiincloudtech.hashnode.dev·Jun 20 · 24 min read👋 Everything about EKS & AI Infrastructure Newsletter "#73" ☁️❤👨💻Dear EKS & AI Infrastructure enthusiasts,Welcome to Everything about EKS & AI Infrastructure #73. There’s a thread running under this edition, and it’s the same one Dhaval Nagar named outside it: the 00