The one-hot example where cat and dog sit at cosine zero, identical to cat and Tuesday, is the clearest way I've seen to motivate why embeddings had to exist. It makes the progression from bag-of-words to n-grams feel inevitable rather than arbitrary. If you extend the series, showing where static word2vec still fails, like one vector for a word with two meanings, would set up contextual embeddings really well.
The one-hot example where cat and dog sit at cosine zero, identical to cat and Tuesday, is the clearest way I've seen to motivate why embeddings had to exist. It makes the progression from bag-of-words to n-grams feel inevitable rather than arbitrary. If you extend the series, showing where static word2vec still fails, like one vector for a word with two meanings, would set up contextual embeddings really well.