AI RESEARCH

Understanding Self-Supervised Learning via Latent Distribution Matching

arXiv CS.LG

ArXi:2605.03517v1 Announce Type: new Self-supervised learning (SSL) excels at finding general-purpose latent representations from complex data, yet lacks a unifying theoretical framework that explains the diverse existing methods and guides the design of new ones. We cast SSL as latent distribution matching (LDM): learning representations that maximize their log-probability under an assumed latent model (alignment), while maximizing latent entropy to prevent collapse (uniformity