Trust Region Methods: From REINFORCE to TRPO to PPO
Implement REINFORCE, TRPO, and PPO from scratch in PyTorch on CartPole. Understand why vanilla policy gradients are unstable, how trust regions fix it, and why PPO became the default algorithm in modern RL.