ML//Tree of Thought

- Generalization of chain of thought: explore multiple reasoning paths with lookahead and backtracking.

Generalization of chain of thought: explore multiple reasoning paths with lookahead and backtracking.

Instead of one linear chain, generate a tree of possibilities and evaluate branches before committing.

Trades more compute for better accuracy on planning, search, and multi-step reasoning.

The prompt-engineering precursor to tree search in reasoning models — same principle (branching exploration), but reasoning models implement it with RL training and dedicated compute.