DGDaksh Goelinug-beast.hashnode.dev·2d ago · 2 min readWhy contiguous Data Structures (DS) are faster than non-contiguous DSSummary: The massive performance gap between contiguous DS and node-base structures is due to CPU Cache lines and spatial locality. Deep Dive: RAM Bottleneck: CPU is very fast, but RAM is slow. To pre00
DGDaksh Goelinug-beast.hashnode.dev·Sep 13 · 2 min readBatch Norm vs Layer NormSummary: Batch Norm -> normalizing each feature across batch. Layer Norm -> normalizing the values of each individual example independently. Deep Dive: Suppose we have 4 students (examples / rows)00