AI RESEARCH
TIDE: Every Layer Knows the Token Beneath the Context
arXiv CS.LG
•
ArXi:2605.06216v1 Announce Type: cross We revisit a universally accepted but under-examined design choice in every modern LLM: a token index is looked up once at the input embedding layer and then permanently discarded.