AI RESEARCH
MobileLLM-Flash: Latency-Guided On-Device LLM Design for Industry Scale
arXiv CS.AI
•
ArXi:2603.15954v1 Announce Type: cross Real-time AI experiences call for on-device large language models (OD-LLMs) optimized for efficient deployment on resource-constrained hardware. The most useful OD-LLMs produce near-real-time responses and exhibit broad hardware compatibility, maximizing user reach. We present a methodology for designing such models using hardware-in-the-loop architecture search under mobile latency constraints.