Bahdanau Attention

The paper Neural Machine Translation by Jointly Learning to Align and Translate formally introduced the concept of attention for the first time. One of the illustrations (shown below) presented in the paper Learning Phrase Representations using RNN E...