AI RESEARCH
Budget-Aware Routing for Long Clinical Text
arXiv CS.AI
•
ArXi:2605.00336v1 Announce Type: cross A key challenge for large language models is token cost per query and overall deployment cost. Clinical inputs are long, heterogeneous, and often redundant, while downstream tasks are short and high stakes. We study budgeted context selection, where a subset of document units is chosen under a strict token budget so an off-the-shelf generator can meet fixed cost and latency constraints.