SRShalem Raju Sinshalem-raju.hashnode.dev·Mar 22 · 18 min readWhy Traditional RAG Fails at Multi-Hop Reasoning (And My Journey Building a GraphRAG Fix)I recently set out with a specific goal: I wanted to build an AI agent that could truly understand a massive, undocumented codebase. If you’ve ever tried to feed a codebase into a standard Retrieval-A00
SRShalem Raju Sinshalem-raju.hashnode.dev·Mar 7 · 4 min readThe Final Assembly: Building the Complete Transformer from Scratch in PyTorchWe finally made it. If you have been following this "learning in public" series from the beginning, we have been deep in the trenches of PyTorch tensor shapes. We’ve built Supermarket Embeddings, inje00
SRShalem Raju Sinshalem-raju.hashnode.dev·Mar 7 · 4 min readPutting the Pieces Together: Building the Transformer Decoder Block in PyTorchIf you’ve been following my "learning in public" series, we’ve spent the last few posts in the trenches. We’ve wrestled with tensor shapes, built mathematical blindfolds (Masked Self-Attention), bridg00
SRShalem Raju Sinshalem-raju.hashnode.dev·Mar 6 · 5 min readDecoding the Decoder: Masked Self-Attention and Cross-Attention in PyTorchIf you’ve been following this "learning in public" PyTorch series, we have successfully built the entire Transformer Encoder. We gave it a sentence, mapped it to embeddings, added spatial awareness, a00
SRShalem Raju Sinshalem-raju.hashnode.dev·Mar 5 · 7 min readCompleting the Transformer Encoder: Add & Norm and the Feed-Forward LayerIf you’ve been following my PyTorch "learning in public" series, we’ve already tackled the hardest part of the Transformer architecture: Multi-Head Attention (MHA). We took our tokens, split them into00
