AI RESEARCH

Learn where to Click from Yourself: On-Policy Self-Distillation for GUI Grounding

arXiv CS.AI

ArXi:2605.00642v1 Announce Type: new Graphical User Interface (GUI) grounding maps natural language instructions to the visual coordinates of target elements and serves as a core capability for autonomous GUI agents. Recent reinforcement learning methods (e.g., GRPO) have achieved strong performance, but they rely on expensive multiple rollouts and suffer from sparse signals on hard samples. These limitations make on-policy self-distillation (OPSD), which provides dense token-level supervision from a single rollout, a promising alternative.