AI RESEARCH
ACES: Who Tests the Tests? Leave-One-Out AUC Consistency for Code Generation
arXiv CS.LG
•
ArXi:2604.03922v1 Announce Type: new Selecting LLM-generated code candidates using LLM-generated tests is challenging because the tests themselves may be incorrect. Existing methods either treat all tests equally or rely on ad-hoc heuristics to filter unreliable tests. Yet determining test correctness requires knowing which codes are correct, creating a \emph{circular dependency}. Our key insight is that we need not determine test correctness at all: \emph{test votes should rank, not merely count.