Scaling Laws and the Bitter Lesson

In 2019, a researcher named Richard Sutton — one of the people most responsible for reinforcement learning becoming a thing — wrote a short essay called "The Bitter Lesson." It's about 1,500 words. It's probably the single most important essay about ...