AI Psychometrics: Evaluating the Psychological Reasoning of Large Language Models with Psychometric Validities

ArXi:2603.11279v1 Announce Type: new The immense number of parameters and deep neural networks make large language models (LLMs) rival the complexity of human brains, which also makes them opaque ``black box'' systems that are challenging to evaluate and interpret. AI Psychometrics is an emerging field that aims to tackle these challenges by applying psychometric methodologies to evaluate and interpret the psychological traits and processes of artificial intelligence (AI) systems.