AI RESEARCH
Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More
arXiv CS.LG
•
ArXi:2502.07490v3 Announce Type: replace-cross Large Language Models (LLMs) are discovered to suffer from accurately retrieving key information. To address this, we propose Mask-Enhanced Autoregressive Prediction (MEAP), a simple yet effective