A Survey on Contextual Embeddings

Contextual representations: a compact synthesis From static vectors to context‑conditioned tokens At first glance the most important shift in recent years is clear: contextual embeddings replace fixed lookups and thereby capture token meaning conditi...