Self-Attention in NLP

Self-attention is a key idea in modern Natural Language Processing (NLP). It helps a model understand how words in a sentence relate to each other. Instead of reading words one by one, the model looks