AI RESEARCH
On the Cone Effect and Modality Gap in Medical Vision-Language Embeddings
arXiv CS.LG
•
ArXi:2603.17246v1 Announce Type: new Vision-Language Models (VLMs) exhibit a characteristic "cone effect" in which nonlinear encoders map embeddings into highly concentrated regions of the representation space, contributing to cross-modal separation known as the modality gap. While this phenomenon has been widely observed, its practical impact on supervised multimodal learning -particularly in medical domains- remains unclear. In this work, we