AI RESEARCH
In-context Learning in Presence of Spurious Correlations
arXiv CS.LG
•
ArXi:2410.03140v2 Announce Type: replace Large language models exhibit a remarkable capacity for in-context learning, where they learn to solve tasks given a few examples. Recent work has shown that transformers can be trained to perform simple regression tasks in-context. This work explores the possibility of