The Attention Revolution

Introduction This article aims to explore the paradigm shift in the field of Natural Language Processing (NLP) before and after 2017. To understand this shift, let’s first look at how things worked before 2017. Before 2017, most NLP models were based...