AI RESEARCH
One Identity, Many Roles: Multimodal Entity Coreference for Enhanced Video Situation Recognition
arXiv CS.CV
•
ArXi:2604.23173v1 Announce Type: new Video Situation Recognition (VidSitu) addresses the challenging problem of "who did what to whom, with what, how, and where" in a video. It tests thorough video understanding by requiring identification of salient actions and associated short descriptions for event roles across multiple events. Grounding with VidSitu requires spatio-temporal localization of key entities across shots and varied appearances. We posit that coherent video understanding requires consistent identification of entities that play different roles.