AI RESEARCH

DiffVC: A Non-autoregressive Framework Based on Diffusion Model for Video Captioning

arXiv CS.CV

ArXi:2604.08084v1 Announce Type: new Current video captioning methods usually use an encoder-decoder structure to generate text autoregressively. However, autoregressive methods have inherent limitations such as slow generation speed and large cumulative error. Furthermore, the few non-autoregressive counterparts suffer from deficiencies in generation quality due to the lack of sufficient multimodal interaction modeling. Therefore, we propose a non-autoregressive framework based on Diffusion model for Video Captioning (DiffVC) to address these issues.