AI RESEARCH
(1D) Ordered Tokens Enable Efficient Test-Time Search
arXiv CS.AI
•
ArXi:2604.15453v1 Announce Type: cross Tokenization is a key component of autoregressive (AR) generative models, converting raw data into manageable units for modeling. Commonly, tokens describe local information, such as regions of pixels in images or word pieces in text, and AR generation predicts these tokens in a fixed order. A worthwhile question is whether token structures affect the ability to steer the generation through test-time search, where multiple candidate generations are explored and evaluated by a verifier.