Beyond Surrogates: A Quantitative Analysis for Inter-Metric Relationships

ArXi:2603.07671v1 Announce Type: new The Consistency property between surrogate losses and evaluation metrics has been extensively studied to ensure that minimizing a loss leads to metric optimality. However, the direct relationship between different evaluation metrics remains significantly underexplored. This theoretical gap results in the "Metric Mismatch" frequently observed in industrial applications, where gains in offline validation metrics fail to translate into online performance.