[PDF][PDF] Word predictability, prosody, gesture and mouth movements in face-to-face language comprehension

Y Zhang, D Frassinelli, J Tuomainen, JI Skipper… - …, 2020 - pdfs.semanticscholar.org
The ecology of human language is face-to-face interaction, comprising cues, like prosody,
cospeech gestures, and mouth movements. Yet, the multimodal context is usually stripped …

More than words: Word predictability, prosody, gesture and mouth movements in natural language comprehension

Y Zhang, D Frassinelli, J Tuomainen… - … of the Royal …, 2021 - royalsocietypublishing.org
The ecology of human language is face-to-face interaction, comprising cues such as
prosody, co-speech gestures and mouth movements. Yet, the multimodal context is usually …

Comprehension in-situ: how multimodal information shapes language processing

Y Zhang - 2022 - discovery.ucl.ac.uk
The human brain supports communication in dynamic face-to-face environments where
spoken words are embedded in linguistic discourse and accompanied by multimodal cues …

[HTML][HTML] The role of multimodal cues in second language comprehension

Y Zhang, R Ding, D Frassinelli, J Tuomainen… - Scientific Reports, 2023 - nature.com
In face-to-face communication, multimodal cues such as prosody, gestures, and mouth
movements can play a crucial role in language processing. While several studies have …

Predicting audiovisual speech: early combined effects of sentential and visual constraints

HS Økland, A Todorović, CS Lüttke, JM McQueen… - BioRxiv, 2018 - biorxiv.org
In language comprehension, a variety of contextual cues act in unison to render upcoming
words more or less predictable. As a sentence unfolds, we use prior context (sentential …

[HTML][HTML] Electrophysiological evidence for the enhancement of gesture-speech integration by linguistic predictability during multimodal discourse comprehension

F Hintz, YH Khoe, A Strauß, AJA Psomakas… - Cognitive, Affective, & …, 2023 - Springer
In face-to-face discourse, listeners exploit cues in the input to generate predictions about
upcoming words. Moreover, in addition to speech, speakers produce a multitude of visual …

The role of visual cues in speech comprehension: evidence from brain and behaviour

AM Krason - 2023 - discovery.ucl.ac.uk
Face-to-face communication is multimodal. It comprises a plethora of linguistic and non-
linguistic cues, such as gestures, face and body movements, eye gaze, and prosody, that …

Electrophysiological signatures of multimodal comprehension in second language

Y Zhang, R Ding, D Frassinelli… - Proceedings of the …, 2021 - escholarship.org
Language is multimodal: non-linguistic cues, such as prosody, gestures and mouth
movements, are always present in face-to-face communication and interact to support …

Functional segregation of conversational production and comprehension when using word predictability

C Arvidsson, J Sundstrom, J Udden - bioRxiv, 2024 - biorxiv.org
The extent to which the language production and comprehension systems overlap remains
debated. We address this debate using a dataset where participants engaged in unscripted …

[PDF][PDF] Beat gestures and prosodic stress interactively influence language comprehension

A Ferrari, P Hagoort - 2024 - osf.io
Face-to-face communication is not only about 'what'is said but also 'how'it is said, both in
speech and bodily signals. Beat gestures are rhythmic hand movements that typically …