On the opportunities and risks of foundation models

R Bommasani, DA Hudson, E Adeli, R Altman… - arXiv preprint arXiv …, 2021 - arxiv.org
AI is undergoing a paradigm shift with the rise of models (eg, BERT, DALL-E, GPT-3) that are
trained on broad data at scale and are adaptable to a wide range of downstream tasks. We …

[HTML][HTML] Evaluating information-theoretic measures of word prediction in naturalistic sentence reading

C Aurnhammer, SL Frank - Neuropsychologia, 2019 - Elsevier
We review information-theoretic measures of cognitive load during sentence processing that
have been used to quantify word prediction effort. Two such measures, surprisal and next …

Expanding horizons of cross-linguistic research on reading: The Multilingual Eye-movement Corpus (MECO)

N Siegelman, S Schroeder, C Acartürk, HD Ahn… - Behavior research …, 2022 - Springer
Scientific studies of language behavior need to grapple with a large diversity of languages in
the world and, for reading, a further variability in writing systems. Yet, the ability to form …

Lossy‐context surprisal: An information‐theoretic model of memory effects in sentence processing

R Futrell, E Gibson, RP Levy - Cognitive science, 2020 - Wiley Online Library
A key component of research on human sentence processing is to characterize the
processing difficulty associated with the comprehension of words in context. Models that …

[HTML][HTML] The ERP response to the amount of information conveyed by words in sentences

SL Frank, LJ Otten, G Galli, G Vigliocco - Brain and language, 2015 - Elsevier
Reading times on words in a sentence depend on the amount of information the words
convey, which can be estimated by probabilistic language models. We investigate whether …

[PDF][PDF] Predictive power of word surprisal for reading times is a linear function of language model quality

A Goodkind, K Bicknell - Proceedings of the 8th workshop on …, 2018 - aclanthology.org
Within human sentence processing, it is known that there are large effects of a word's
probability in context on how long it takes to read it. This relationship has been quantified …

Presenting GECO: An eyetracking corpus of monolingual and bilingual sentence reading

U Cop, N Dirix, D Drieghe, W Duyck - Behavior research methods, 2017 - Springer
This article introduces GECO, the Ghent Eye-Tracking Corpus, a monolingual and bilingual
corpus of the eyetracking data of participants reading a complete novel. English …

Readability research: An interdisciplinary approach

S Beier, S Berlow, E Boucaud… - … and Trends® in …, 2022 - nowpublishers.com
The control provided by digital displays over how visual information is presented to readers
has the potential to improve reading for each and every reader, regardless of ability or …

Human sentence processing: Recurrence or attention?

D Merkx, SL Frank - arXiv preprint arXiv:2005.09471, 2020 - arxiv.org
Recurrent neural networks (RNNs) have long been an architecture of interest for
computational models of human sentence processing. The recently introduced Transformer …

CogniVal: A framework for cognitive word embedding evaluation

N Hollenstein, A de la Torre, N Langer… - arXiv preprint arXiv …, 2019 - arxiv.org
An interesting method of evaluating word representations is by how much they reflect the
semantic representations in the human brain. However, most, if not all, previous works only …