I Spent $0.48 to Find Out When MCTS Actually Works for LLM Reasoning

Does tree search help LLM reasoning? The literature can't decide. ReST-MCTS* says yes. AB-MCTS got a NeurIPS spotlight. "Limits of PRM-Guided Tree Search" says no: MCTS with a process reward model used 11x more tokens than best-of-N for zero accuracy...