Nov 27, 2025 · 22 min read · Every time you ask ChatGPT a question, get a movie recommendation on Netflix, or watch your phone recognize faces in photos, billions of matrix multiplications are happening behind the scenes. This fundamental mathematical operation has become the co...
Join discussionNov 27, 2025 · 43 min read · In our previous blog, we explored GPU computing fundamentals: memory hierarchies, thread organization, warps, memory coalescing, and kernel classification (memory-bound vs. compute-bound). In this blog, we apply these concepts to optimize GEMM (Gener...
Join discussionAug 22, 2025 · 5 min read · 1. CUDA Thread Hierarchy The CUDA thread hierarchy consists of four levels: threads, warps, blocks, and grids. (a) Thread The smallest unit is the thread. A thread is the lowest level in the CUDA thread hierarchy and serves as the basic unit that p...
Join discussion