Technical Addendum: The Mathematics of Sophisticated Shuffling in RL

Abstract This addendum provides a rigorous mathematical treatment of the “shuffling” phenomenon in reinforcement learning for large language models. We formalize the concept of reasoning bubbles, prove fundamental support constraints, and derive four...