RoPE Explained 🪢

Every once in a while, you come across these concepts that are so tricky to grasp, they tickle the insides of your brain. Introducing RoPE, he gave me a hard time last week. Hi future-me, who forgot how RoPE works, this is for you. RoPE stands for Ro...