AI RESEARCH

Schema for In-Context Learning

arXiv CS.AI

ArXi:2510.13905v3 Announce Type: replace-cross In-Context Learning (ICL) enables transformer-based language models to adapt to new tasks by conditioning on nstration examples. However, traditional example-driven in-context learning lacks explicit modules for knowledge retrieval and transfer at the abstraction level. Inspired by cognitive science, specifically schema theory, which holds that humans interpret new information by activating pre-existing mental frameworks (schemas) to structure understanding, we