The Inside of a Model - Part D: Transformers

Previously, we talked about MLPs, how models learn, and why raw MLPs, CNNs, and RNNs eventually led us here. This post is about the architecture that changed modern AI more than any other architecture