AI RESEARCH
Just did an analysis on ICLR 2025 vs 2026 scores and WOW [D]
r/MachineLearning
•
Per, the scores corr between 2 human is about 0.41 for ICLR 2025, but in my current project I am seeing a much lower corr for ICLR 2026. So I ran the metrics for both 2025 and 2026 and it is crazy. I used 2 metrics, one-vs-rest corr and half-half split corr. All data are fetched from OpenReview. I do know that top conf reviews are just a lottery now for most papers, but i nenver thought it is this bad.