AI RESEARCH
Optimal In-context Adaptivity and Distributional Robustness of Transformers
arXiv CS.LG
•
ArXi:2510.23254v3 Announce Type: replace-cross We study in-context learning problems where a Transformer is pretrained on tasks drawn from a mixture distribution $\pi=\sum_{\alpha\in\mathcal{A}} \lambda_{\alpha} \pi_{\alpha}$, called the pre