Rep2Text: Decoding Full Text from a Single LLM Token Representation

ArXi:2511.06571v2 Announce Type: replace-cross Large language models (LLMs) have achieved remarkable progress across diverse tasks, yet their internal mechanisms remain largely opaque. In this work, we investigate a fundamental question: to what extent can the original input text be recovered from a single last-token representation in an LLM? To this end, we propose Rep2Text, a novel framework for decoding text from last-token representations.