Motion-Adaptive Temporal Attention for Lightweight Video Generation with Stable Diffusion

ArXi:2603.17398v1 Announce Type: new We present a motion-adaptive temporal attention mechanism for parameter-efficient video generation built upon frozen Stable Diffusion models. Rather than treating all video content uniformly, our method dynamically adjusts temporal attention receptive fields based on estimated motion content: high-motion sequences attend locally across frames to preserve rapidly changing details, while low-motion sequences attend globally to enforce scene consistency.