AI RESEARCH
The Metacognitive Probe: Five Behavioural Calibration Diagnostics for LLMs
arXiv CS.AI
•
ArXi:2605.09844v1 Announce Type: new The Metacognitive Probe is an exploratory five-task, 15-slot diagnostic that decomposes an LLM's confidence behaviour into five behaviourally-distinct dimensions: confidence calibration (T1-CC), epistemic vigilance (T2-EV), knowledge boundary (T3-KB), calibration range (T4-CR), and reasoning-chain validation (T5-RCV). It is evaluated on N=8 frontier models and N=69 humans.