Termsslug: token-space

Token Space

词元空间

The discrete token representation space in which model-generated sequences unfold.

Curated Intelligence

1 items · Page 1/1
Hacker News AIT2·Models
62 pts
Reasoning as Pathfinding Through Token Space

Alex Wang frames reasoning as pathfinding in token space, where each sample is an attempt to find a path from the starting context to a correct answer. This lens explains a puzzle: RL-trained models write longer chains and get more accurate, yet forcing a single chain to run longer at inference helps only briefly before plateauing or degrading. The framework separates the contributions of chain length versus search breadth.