Investigating Multimodal Large Language Models to Support Usability Evaluation

ArXi:2508.16165v2 Announce Type: replace-cross Usability evaluation is an essential method to the design of effective and intuitive user interfaces (UIs). However, it commonly relies on resource-intensive, expert-driven methods, which limit its accessibility, especially for small organizations. Recent multimodal large language models (MLLMs) have the potential to usability evaluation by analyzing textual instructions together with visual UI context. This paper investigates the use of MLLMs as assistive tools for usability evaluation by framing the task as a prioritization problem.