Shifting AI Efficiency From Model-Centric to Data-Centric Compression

Shifting the Bottleneck: From Parameters to Tokens Background and motivation At first glance the history of scaling in language and multimodal models reads like a parameter race, but the landscape now appears to pivot: bottlenecks are increasingly dr...