On the opportunities and risks of foundation models
AI is undergoing a paradigm shift with the rise of models (eg, BERT, DALL-E, GPT-3) that are
trained on broad data at scale and are adaptable to a wide range of downstream tasks. We …
trained on broad data at scale and are adaptable to a wide range of downstream tasks. We …
[HTML][HTML] Evaluating information-theoretic measures of word prediction in naturalistic sentence reading
C Aurnhammer, SL Frank - Neuropsychologia, 2019 - Elsevier
We review information-theoretic measures of cognitive load during sentence processing that
have been used to quantify word prediction effort. Two such measures, surprisal and next …
have been used to quantify word prediction effort. Two such measures, surprisal and next …
Expanding horizons of cross-linguistic research on reading: The Multilingual Eye-movement Corpus (MECO)
Scientific studies of language behavior need to grapple with a large diversity of languages in
the world and, for reading, a further variability in writing systems. Yet, the ability to form …
the world and, for reading, a further variability in writing systems. Yet, the ability to form …
Lossy‐context surprisal: An information‐theoretic model of memory effects in sentence processing
A key component of research on human sentence processing is to characterize the
processing difficulty associated with the comprehension of words in context. Models that …
processing difficulty associated with the comprehension of words in context. Models that …
[HTML][HTML] The ERP response to the amount of information conveyed by words in sentences
Reading times on words in a sentence depend on the amount of information the words
convey, which can be estimated by probabilistic language models. We investigate whether …
convey, which can be estimated by probabilistic language models. We investigate whether …
[PDF][PDF] Predictive power of word surprisal for reading times is a linear function of language model quality
A Goodkind, K Bicknell - Proceedings of the 8th workshop on …, 2018 - aclanthology.org
Within human sentence processing, it is known that there are large effects of a word's
probability in context on how long it takes to read it. This relationship has been quantified …
probability in context on how long it takes to read it. This relationship has been quantified …
Presenting GECO: An eyetracking corpus of monolingual and bilingual sentence reading
This article introduces GECO, the Ghent Eye-Tracking Corpus, a monolingual and bilingual
corpus of the eyetracking data of participants reading a complete novel. English …
corpus of the eyetracking data of participants reading a complete novel. English …
Readability research: An interdisciplinary approach
S Beier, S Berlow, E Boucaud… - … and Trends® in …, 2022 - nowpublishers.com
The control provided by digital displays over how visual information is presented to readers
has the potential to improve reading for each and every reader, regardless of ability or …
has the potential to improve reading for each and every reader, regardless of ability or …
Human sentence processing: Recurrence or attention?
D Merkx, SL Frank - arXiv preprint arXiv:2005.09471, 2020 - arxiv.org
Recurrent neural networks (RNNs) have long been an architecture of interest for
computational models of human sentence processing. The recently introduced Transformer …
computational models of human sentence processing. The recently introduced Transformer …
CogniVal: A framework for cognitive word embedding evaluation
N Hollenstein, A de la Torre, N Langer… - arXiv preprint arXiv …, 2019 - arxiv.org
An interesting method of evaluating word representations is by how much they reflect the
semantic representations in the human brain. However, most, if not all, previous works only …
semantic representations in the human brain. However, most, if not all, previous works only …