AI RESEARCH
A visual observation on the geometry of UMAP projections of the difference vectors of antonym and synonym word pair embeddings
arXiv CS.LG
•
ArXi:2603.24150v1 Announce Type: cross Antonyms, or opposites, are sometimes defined as \emph{word pairs that have all of the same contextually relevant properties but one}. Seeing how transformer models seem to encode concepts as directions, this begs the question if one can detect ``antonymity'' in the geometry of the embedding vectors of word pairs, especially based on their difference vectors. Such geometrical studies are then naturally contrasted by comparing antonymic pairs to their opposites; synonyms.