The Transformer, Piece by Piece

In the last post we met attention: every word in a sentence walking into a library, glancing at every other word, and copying the relevant content into its own notebook. That's the core move. But a transformer is not just attention. If attention is a...