I Spent $0.48 to Find Out When MCTS Actually Works for LLM Reasoning
Does tree search help LLM reasoning? The literature can't decide.
ReST-MCTS* says yes. AB-MCTS got a NeurIPS spotlight. "Limits of
PRM-Guided Tree Search" says no: MCTS with a process reward model used
11x more tokens than best-of-N for zero accuracy...
