AI RESEARCH
Should We Still Pretrain Encoders with Masked Language Modeling?
arXiv CS.CL
•
ArXi:2507.00994v4 Announce Type: replace Learning high-quality text representations is fundamental to a wide range of NLP tasks. While encoder pre