Positional Embeddings: An Intuitive Guide

Positional Embeddings are a term that come up often in discussions about transformers, and can seem scary at first. In this article we will explore intuitively what they are, why they’re useful, and how they work! Note: This article will be a bit mat...