[HTML][HTML] Evaluating information-theoretic measures of word prediction in naturalistic sentence reading

C Aurnhammer, SL Frank - Neuropsychologia, 2019 - Elsevier
We review information-theoretic measures of cognitive load during sentence processing that
have been used to quantify word prediction effort. Two such measures, surprisal and next …

The neural architecture of language: Integrative modeling converges on predictive processing

M Schrimpf, IA Blank, G Tuckute… - Proceedings of the …, 2021 - National Acad Sciences
The neuroscience of perception has recently been revolutionized with an integrative
modeling approach in which computation, brain function, and behavior are linked across …

Do domain-general executive resources play a role in linguistic prediction? Re-evaluation of the evidence and a path forward

R Ryskin, RP Levy, E Fedorenko - Neuropsychologia, 2020 - Elsevier
Most current accounts of language comprehension agree on a role for prediction, but they
disagree on the importance of domain-general executive resources in predictive behavior. In …

[PDF][PDF] On the predictive power of neural language models for human real-time comprehension behavior

EG Wilcox - arXiv preprint arXiv:2006.01912, 2020 - escholarship.org
Human reading behavior is tuned to the statistics of natural language: the time it takes
human subjects to read a word can be predicted from estimates of the word's probability in …

fMRI reveals language-specific predictive coding during naturalistic sentence comprehension

C Shain, IA Blank, M van Schijndel, W Schuler… - Neuropsychologia, 2020 - Elsevier
Much research in cognitive neuroscience supports prediction as a canonical computation of
cognition across domains. Is such predictive coding implemented by feedback from higher …

Lossy‐context surprisal: An information‐theoretic model of memory effects in sentence processing

R Futrell, E Gibson, RP Levy - Cognitive science, 2020 - Wiley Online Library
A key component of research on human sentence processing is to characterize the
processing difficulty associated with the comprehension of words in context. Models that …

Revisiting the uniform information density hypothesis

C Meister, T Pimentel, P Haller, L Jäger… - arXiv preprint arXiv …, 2021 - arxiv.org
The uniform information density (UID) hypothesis posits a preference among language
users for utterances structured such that information is distributed uniformly across a signal …

Artificial neural network language models align neurally and behaviorally with humans even after a developmentally realistic amount of training

EA Hosseini, M Schrimpf, Y Zhang, S Bowman… - BioRxiv, 2022 - biorxiv.org
Artificial neural networks have emerged as computationally plausible models of human
language processing. A major criticism of these models is that the amount of training data …

Functionally distinct language and Theory of Mind networks are synchronized at rest and during language comprehension

AM Paunov, IA Blank… - Journal of …, 2019 - journals.physiology.org
Communication requires the abilities to generate and interpret utterances and to infer the
beliefs, desires, and goals of others (“Theory of Mind”; ToM). These two abilities have been …

Incremental language comprehension difficulty predicts activity in the language network but not the multiple demand network

L Wehbe, IA Blank, C Shain, R Futrell, R Levy… - Cerebral …, 2021 - academic.oup.com
What role do domain-general executive functions play in human language comprehension?
To address this question, we examine the relationship between behavioral measures of …