A deep learning mechanism called self-attention

[47] Self-attention Self-attention is a mechanism in deep learning, particularly in the field of natural language processing (NLP) and computer vision, that allows a model to weigh the importance of different parts of the input when making prediction...