AI RESEARCH
VERT: Reliable LLM Judges for Radiology Report Evaluation
arXiv CS.AI
•
ArXi:2604.03376v1 Announce Type: new Current literature on radiology report evaluation has focused primarily on designing LLM-based metrics and fine-tuning small models for chest X-rays. However, it remains unclear whether these approaches are robust when applied to reports from other modalities and anatomies. Which model and prompt configurations are best suited to serve as LLM judges for radiology evaluation? We conduct a thorough correlation analysis between expert and LLM-based ratings.