TTanvi Ausare·Jun 15Operators for the Inference Era: Simplifying LLM Serving on KubernetesLearn how Kubernetes Operators simplify LLM serving on Kubernetes through automated deployment, scaling, GPU management, and reliable AI inference operations at scale.9 min read·neevcloud.hashnode.dev
SSrujan Reddy·Jan 5LLM-D: Serving AI Inference at scaleIntroduction: AI inference is the "doing" part of artificial intelligence. It's the moment a trained model stops learning and starts working, turning its knowledge into real-world results. We all use cutting-edge frontier models in our day-to-day u...3 min read·srujanpakanati.com