PLDR-LLMs Reason At Self-Organized Criticality

ArXi:2603.23539v1 Announce Type: cross We show that PLDR-LLMs pretrained at self-organized criticality exhibit reasoning at inference time. The characteristics of PLDR-LLM deductive outputs at criticality is similar to second-order phase transitions. At criticality, the correlation length diverges, and the deductive outputs attain a metastable steady state. The steady state behaviour suggests that deductive outputs dataset, leading to generalization and reasoning capabilities in the process.