AI RESEARCH

Seg-Agent: Test-Time Multimodal Reasoning for Training-Free Language-Guided Segmentation

arXiv CS.AI

ArXi:2605.12953v1 Announce Type: cross Language-guided segmentation transcends the scope limitations of traditional semantic segmentation, enabling models to segment arbitrary target regions based on natural language instructions. Existing approaches typically adopt a two-stage framework: employing Multimodal Large Language Models (MLLMs) to interpret instructions and generate visual prompts, followed by foundational segmentation models (e.g., SAM) to produce masks. However, due to the limited spatial grounding capabilities of off-the-shelf MLLMs, these methods often rely on extensive