Analyzing cognitive plausibility of subword tokenization

L Beinborn, Y Pinter - arXiv preprint arXiv:2310.13348, 2023 - arxiv.org
Subword tokenization has become the de-facto standard for tokenization, although
comparative evaluations of subword vocabulary quality across languages are scarce …

[HTML][HTML] Individual differences in holistic and compositional language processing

K McConnell - Journal of Cognition, 2023 - ncbi.nlm.nih.gov
Individual differences in cognitive abilities are ubiquitous across the spectrum of proficient
language users. Although speakers differ with regard to their memory capacity, ability for …

The use of eye movement corpora in vocabulary research

M Brysbaert, D Drieghe - Research Methods in Applied Linguistics, 2024 - Elsevier
Abstract Analysis of existing datasets of eye movements in reading is a valuable tool for
vocabulary research because it allows researchers to examine word recognition in an …

Rethinking tokenization: Crafting better tokenizers for large language models

J Yang - International Journal of Chinese Linguistics, 2024 - jbe-platform.com
Tokenization significantly influences language models (LMs)'performance. This paper traces
the evolution of tokenizers from word-level to subword-level, analyzing how they balance …

Modeling Task Effects in Human Reading with Neural Network-based Attention

M Hahn, F Keller - arXiv preprint arXiv:1808.00054, 2018 - arxiv.org
Research on human reading has long documented that reading behavior shows task-
specific effects, but it has been challenging to build general models predicting what reading …

阅读研究中常用眼动控制模型的对比分析

陈松林, 陈新炜, 李璜夏, 药盼盼 - 心理科学进展, 2024 - journal.psych.ac.cn
建立于序列加工理论, 平行加工理论和交互激活理论, 一些经典的眼动控制模型对阅读过程中
常见的眼动行为, 实验效应及其背后可能的信息加工认知机制进行了模拟和探究. 阅读研究中的5 …

Modeling task effects in human reading with neural network-based attention

M Hahn, F Keller - Cognition, 2023 - Elsevier
Research on human reading has long documented that reading behavior shows task-
specific effects, but it has been challenging to build general models predicting what reading …

Comparison of models of eye movement in reading

S CHEN, X CHEN, H LI, P YAO - Advances in Psychological …, 2024 - journal.psych.ac.cn
Based on sequential processing theory, parallel processing theory and interactive activation
theory, some classic models about eye movement control are constructed to simulate the …

Unsupervised text segmentation predicts eye fixations during reading

J Yang, A van den Bosch, SL Frank - 2021 - osf.io
Abstract Words typically form the basis of psycholinguistic and computational linguistic
studies about sentence processing. However, recent evidence shows the basic units during …