The Bitter Lesson of Tokenization: A Breakthrough in How AI Reads

This echoes Rich Sutton’s Bitter Lesson: “The biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin. The ultimate reason for this is Moo...