AIadel Iazzagintechshinobi.hashnode.dev·May 12 · 14 min readWhat AI training parallelism actually means for your network fabric If you work in AI infrastructure networking, you've probably heard terms like Data Parallelism, Tensor Parallelism, and Pipeline Parallelism thrown around by the ML team. You know they matter for how 00
AIadel Iazzagintechshinobi.hashnode.dev·Apr 10 · 12 min readHow does RoCE actually deliver a Lossless network ?Introduction If you have been learning about AI networking recently, I am sure you have heard the term "Lossless" thrown around a lot, what does lossless even mean in the context of networking ? To un00
AIadel Iazzagintechshinobi.hashnode.dev·Sep 17, 2025 · 10 min readUltra Ethernet 1.0 Specification: What Is Libfabric ?Introduction Hello everyone! It’s been a while. I am immersing myself in the UE spec once again and this time I want to talk about libfabric. Even though this is the sort of topic that us network engineers sort of gloss over thinking it’s not importa...00
AIadel Iazzagintechshinobi.hashnode.dev·Apr 29, 2025 · 12 min readNetwork Engineers' Introductory Guide to NCCLIntroduction In the rapidly evolving field of large language models (LLMs) and deep learning, training these complex models often requires distributed computing. This involves splitting the workload across multiple GPUs or even multiple nodes to achi...00
AIadel Iazzagintechshinobi.hashnode.dev·Apr 22, 2025 · 5 min readWhat You Need to Know About Artificial IntelligenceWhat is AI ? AI stands for artificial intelligence, it is rather a broad field of study than one specific topic. AI is basically using computers to do things that require human intelligence ranging from simple activities such as playing chess, recogn...00
