[PDF][PDF] Word predictability, prosody, gesture and mouth movements in face-to-face language comprehension
The ecology of human language is face-to-face interaction, comprising cues, like prosody,
cospeech gestures, and mouth movements. Yet, the multimodal context is usually stripped …
cospeech gestures, and mouth movements. Yet, the multimodal context is usually stripped …
More than words: Word predictability, prosody, gesture and mouth movements in natural language comprehension
The ecology of human language is face-to-face interaction, comprising cues such as
prosody, co-speech gestures and mouth movements. Yet, the multimodal context is usually …
prosody, co-speech gestures and mouth movements. Yet, the multimodal context is usually …
Comprehension in-situ: how multimodal information shapes language processing
Y Zhang - 2022 - discovery.ucl.ac.uk
The human brain supports communication in dynamic face-to-face environments where
spoken words are embedded in linguistic discourse and accompanied by multimodal cues …
spoken words are embedded in linguistic discourse and accompanied by multimodal cues …
[HTML][HTML] The role of multimodal cues in second language comprehension
Y Zhang, R Ding, D Frassinelli, J Tuomainen… - Scientific Reports, 2023 - nature.com
In face-to-face communication, multimodal cues such as prosody, gestures, and mouth
movements can play a crucial role in language processing. While several studies have …
movements can play a crucial role in language processing. While several studies have …
Predicting audiovisual speech: early combined effects of sentential and visual constraints
HS Økland, A Todorović, CS Lüttke, JM McQueen… - BioRxiv, 2018 - biorxiv.org
In language comprehension, a variety of contextual cues act in unison to render upcoming
words more or less predictable. As a sentence unfolds, we use prior context (sentential …
words more or less predictable. As a sentence unfolds, we use prior context (sentential …
[HTML][HTML] Electrophysiological evidence for the enhancement of gesture-speech integration by linguistic predictability during multimodal discourse comprehension
In face-to-face discourse, listeners exploit cues in the input to generate predictions about
upcoming words. Moreover, in addition to speech, speakers produce a multitude of visual …
upcoming words. Moreover, in addition to speech, speakers produce a multitude of visual …
The role of visual cues in speech comprehension: evidence from brain and behaviour
AM Krason - 2023 - discovery.ucl.ac.uk
Face-to-face communication is multimodal. It comprises a plethora of linguistic and non-
linguistic cues, such as gestures, face and body movements, eye gaze, and prosody, that …
linguistic cues, such as gestures, face and body movements, eye gaze, and prosody, that …
Electrophysiological signatures of multimodal comprehension in second language
Y Zhang, R Ding, D Frassinelli… - Proceedings of the …, 2021 - escholarship.org
Language is multimodal: non-linguistic cues, such as prosody, gestures and mouth
movements, are always present in face-to-face communication and interact to support …
movements, are always present in face-to-face communication and interact to support …
Functional segregation of conversational production and comprehension when using word predictability
C Arvidsson, J Sundstrom, J Udden - bioRxiv, 2024 - biorxiv.org
The extent to which the language production and comprehension systems overlap remains
debated. We address this debate using a dataset where participants engaged in unscripted …
debated. We address this debate using a dataset where participants engaged in unscripted …
[PDF][PDF] Beat gestures and prosodic stress interactively influence language comprehension
A Ferrari, P Hagoort - 2024 - osf.io
Face-to-face communication is not only about 'what'is said but also 'how'it is said, both in
speech and bodily signals. Beat gestures are rhythmic hand movements that typically …
speech and bodily signals. Beat gestures are rhythmic hand movements that typically …