AI RESEARCH
VeriOS: Query-Driven Proactive Human-Agent-GUI Interaction for Trustworthy OS Agents
arXiv CS.CL
•
ArXi:2509.07553v3 Announce Type: replace With the rapid progress of multimodal large language models, operating system (OS) agents become increasingly capable of automating tasks through on-device graphical user interfaces (GUIs). However, most existing OS agents are designed for idealized settings, whereas real-world environments often present untrustworthy conditions. To mitigate risks of over-execution in such scenarios, we propose a query-driven human-agent-GUI interaction framework that enables OS agents to decide when to query humans for reliable task completion.