Value Iteration vs Q-Learning: Dynamic Programming Meets RL

You have a map of the frozen lake. Every crack in the ice, every slippery patch, every hole is marked. You can sit at your desk and plan the perfect route before stepping foot on the ice. That is valu