AI RESEARCH

PMT: Plain Mask Transformer for Image and Video Segmentation with Frozen Vision Encoders

arXiv CS.CV

ArXi:2603.25398v1 Announce Type: new Vision Foundation Models (VFMs) pre-trained at scale enable a single frozen encoder to serve multiple downstream tasks simultaneously. Recent VFM-based encoder-only models for image and video segmentation, such as EoMT and VidEoMT, achieve competitive accuracy with remarkably low latency, yet they require finetuning the encoder, sacrificing the multi-task encoder sharing that makes VFMs practically attractive for large-scale deployment.