AI RESEARCH

InfoTok: Adaptive Discrete Video Tokenizer via Information-Theoretic Compression

arXiv CS.AI

ArXi:2512.16975v3 Announce Type: replace-cross Accurate and efficient discrete video tokenization is essential for long video sequences processing. Yet, the inherent complexity and variable information density of videos present a significant bottleneck for current tokenizers, which rigidly compress all content at a fixed rate, leading to redundancy or information loss. Drawing inspiration from Shannon's information theory, this paper