AI RESEARCH
Mixture of Cognitive Reasoners: Modular Reasoning with Brain-Like Specialization
arXiv CS.LG
•
ArXi:2506.13331v3 Announce Type: replace Human cognitive behavior arises from the interaction of specialized brain networks dedicated to distinct functions, such as language, logic, and social reasoning. Inspired by this organization, we propose Mixture of Cognitive Reasoners (MiCRo): a modular, transformer-based architecture post-trained with a curriculum that induces functional specialization across experts. Concretely, we partition the layers of a pretrained language model into four expert modules aligned with well-studied cognitive networks in the human brain.