Language Reconstruction with Brain Predictive Coding from fMRI Data

ArXi:2405.11597v2 Announce Type: replace-cross Many recent studies have shown that the perception of speech can be decoded from brain signals and subsequently reconstructed as continuous language. However, there is a lack of neurological basis for how the semantic information embedded within brain signals can be used effectively to guide language reconstruction. Predictive coding theory suggests the human brain naturally engages in continuously predicting future words that span multiple timescales.