Visualize Attention Mechanism in Sequence to Sequence Models

Attention mechanism is really fascinating. It tries to mimic human way of perceiving the world. In this post, I will provide visualizations on how attention mechanisms work on different simple problems. I will demonstrate them by reversing, right shi...