AI RESEARCH

M3T: Discrete Multi-Modal Motion Tokens for Sign Language Production

arXiv CS.CV

ArXi:2603.23617v1 Announce Type: new Sign language production requires than hand motion generation. Non-manual features, including mouthings, eyebrow raises, gaze, and head movements, are grammatically obligatory and cannot be recovered from manual articulators alone. Existing 3D production systems face two barriers to integrating them: the standard body model provides a facial space too low-dimensional to encode these articulations, and when richer representations are adopted, standard discrete tokenization suffers from codebook collapse, leaving most of the expression space unreachable.