AI RESEARCH

Retrieval from Within: An Intrinsic Capability of Attention-Based Models

arXiv CS.LG

ArXi:2605.05806v1 Announce Type: new Retrieval-augmented generation (RAG) typically treats retrieval and generation as separate systems. We ask whether an attention-based encoder-decoder can instead retrieve directly from its own internal representations. We