Training Computer Use Agents to Assess the Usability of Graphical User Interfaces

ArXi:2604.26020v1 Announce Type: cross Usability testing with experts and potential users can assess the effectiveness, efficiency, and user satisfaction of graphical user interfaces (GUIs) but doing so remains a costly and time-intensive process. Prior work has used computer use agents (CUAs) and other generative agents that can simulate user interactions and preference, but we show that agents still struggle to provide accurate usability assessments.