Neurocomputational models of language processing

JT Hale, L Campanelli, J Li, S Bhattasali… - Annual Review of …, 2022 - annualreviews.org
Efforts to understand the brain bases of language face the Mapping Problem: At what level
do linguistic computations and representations connect to human neurobiology? We review …

[HTML][HTML] Large, open datasets for human connectomics research: Considerations for reproducible and responsible data use

AR Laird - NeuroImage, 2021 - Elsevier
Large, open datasets have emerged as important resources in the field of human
connectomics. In this review, the evolution of data sharing involving magnetic resonance …

Evidence of a predictive coding hierarchy in the human brain listening to speech

C Caucheteux, A Gramfort, JR King - Nature human behaviour, 2023 - nature.com
Considerable progress has recently been made in natural language processing: deep
learning algorithms are increasingly able to generate, summarize, translate and classify …

Brains and algorithms partially converge in natural language processing

C Caucheteux, JR King - Communications biology, 2022 - nature.com
Deep learning algorithms trained to predict masked words from large amount of text have
recently been shown to generate activations similar to those of the human brain. However …

Driving and suppressing the human language network using large language models

G Tuckute, A Sathe, S Srikant, M Taliaferro… - Nature Human …, 2024 - nature.com
Transformer models such as GPT generate human-like language and are predictive of
human brain responses to language. Here, using functional-MRI-measured brain responses …

Toward a realistic model of speech processing in the brain with self-supervised learning

J Millet, C Caucheteux, Y Boubenec… - Advances in …, 2022 - proceedings.neurips.cc
Several deep neural networks have recently been shown to generate activations similar to
those of the brain in response to the same input. These algorithms, however, remain largely …

Scaling laws for language encoding models in fMRI

R Antonello, A Vaidya, A Huth - Advances in Neural …, 2024 - proceedings.neurips.cc
Abstract Representations from transformer-based unidirectional language models are
known to be effective at predicting brain responses to natural language. However, most …

Deep language algorithms predict semantic comprehension from brain activity

C Caucheteux, A Gramfort, JR King - Scientific reports, 2022 - nature.com
Deep language algorithms, like GPT-2, have demonstrated remarkable abilities to process
text, and now constitute the backbone of automatic translation, summarization and dialogue …

The default network dominates neural responses to evolving movie stories

E Yang, F Milisav, J Kopal, AJ Holmes… - Nature …, 2023 - nature.com
Neuroscientific studies exploring real-world dynamic perception often overlook the influence
of continuous changes in narrative content. In our research, we utilize machine learning …

Disentangling syntax and semantics in the brain with deep networks

C Caucheteux, A Gramfort… - … conference on machine …, 2021 - proceedings.mlr.press
The activations of language transformers like GPT-2 have been shown to linearly map onto
brain activity during speech comprehension. However, the nature of these activations …