CUDA shared memory

0) Big picture in 5 lines Global memory is far/slow; shared memory is on-chip, close/fast (visible only within a block). Matrix multiply C = A·B reuses the same data tiles many times → shared memory pays off. Tiling = cut A and B into BLOCK×BLOCK ...