JJakson Tate·5d agoMegatron-DeepSpeed 3D Parallelism: Scaling 100B+ LLM TrainingA production-grade SRE guide to configuring TP, PP, DP, ZeRO optimizations, and NCCL RoCEv2 networks on bare-metal GPU clusters.9 min read·servermo.hashnode.dev