Mixture of Recursions: A model that decides when to think deeper

Introduction Modern AI models are becoming increasingly larger and more sophisticated, but also increasingly expensive to operate. Every improvement seems to demand more memory, more GPUs, and more power. In the pursuit of trying to make better model...