Architectural Case Study: Beyond Quadratic Scaling in Frontier AI

The history of computing is defined by constraints accepted as permanent until an architectural shift renders them obsolete. Since the introduction of the transformer architecture in 2017, quadratic s