WZWeiwei Zhanginaicplight.hashnode.dev·3d ago · 2 min readWhy AI Clusters Need New Optical Technologies Beyond 800GWhen people discuss AI infrastructure, GPUs usually get all the attention. But there is another critical component determining AI scalability: The network. As modern AI clusters grow larger, data move00
WZWeiwei Zhanginaicplight.hashnode.dev·5d ago · 6 min readRoCE Explained: How RDMA over Ethernet Enables Scalable AI InferenceAs AI inference workloads scale across hundreds or thousands of GPUs, networking can become a bottleneck long before compute capacity is exhausted. A traditional TCP/IP network introduces CPU overhead00
WZWeiwei Zhanginaicplight.hashnode.dev·6d ago · 4 min readInfiniBand Explained: Why It Powers Modern AI ClustersArtificial intelligence is transforming data center networking. As AI training clusters scale from hundreds to thousands of GPUs, the network has become just as important as the compute infrastructure00
