Understanding LLM Embeddings from Scratch — Part 7: Sentence Embeddings, Contrastive Learning & Semantic Search

From contextual token representations to a single vector for an entire sentence and why that vector is useful for retrieval. In Part 6, we learned how self-attention changes a token's representation d