AI RESEARCH

MMPhysVideo: Scaling Physical Plausibility in Video Generation via Joint Multimodal Modeling

arXiv CS.CV

ArXi:2604.02817v1 Announce Type: new Despite advancements in generating visually stunning content, video diffusion models (VDMs) often yield physically inconsistent results due to pixel-only reconstruction. To address this, we propose MMPhysVideo, the first framework to scale physical plausibility in video generation through joint multimodal modeling. We recast perceptual cues, specifically semantics, geometry, and spatio-temporal trajectory, into a unified pseudo-RGB format, enabling VDMs to directly capture complex physical dynamics.