The role of visual cues in speech comprehension: evidence from brain and behaviour

AM Krason - 2023 - discovery.ucl.ac.uk
Face-to-face communication is multimodal. It comprises a plethora of linguistic and non-
linguistic cues, such as gestures, face and body movements, eye gaze, and prosody, that …

[HTML][HTML] Multimodal communication in aphasia: Perception and production of co-speech gestures during face-to-face conversation

BC Preisig, N Eggenberger, D Cazzoli… - Frontiers in human …, 2018 - frontiersin.org
The role of nonverbal communication in patients with post-stroke language impairment
(aphasia) is not yet fully understood. This study investigated how aphasic patients perceive …

[HTML][HTML] Gesture in the eye of the beholder: An eye-tracking study on factors determining the attention for gestures produced by people with aphasia

K van Nispen, K Sekine, I van der Meulen, BC Preisig - Neuropsychologia, 2022 - Elsevier
Co-speech hand gestures are an ubiquitous form of nonverbal communication, which can
express additional information that is not present in speech. Hand gestures may become …

Comprehension of co-speech gestures in aphasic patients: An eye movement study

N Eggenberger, BC Preisig, R Schumacher, S Hopfner… - PloS one, 2016 - journals.plos.org
Background Co-speech gestures are omnipresent and a crucial element of human
interaction by facilitating language comprehension. However, it is unclear whether gestures …

Shared and modality-specific brain regions that mediate auditory and visual word comprehension

A Keitel, J Gross, C Kayser - Elife, 2020 - elifesciences.org
Visual speech carried by lip movements is an integral part of communication. Yet, it remains
unclear in how far visual and acoustic speech comprehension are mediated by the same …

The role of iconic gestures and mouth movements in face-to-face communication

A Krason, R Fenton, R Varley, G Vigliocco - Psychonomic bulletin & …, 2021 - Springer
Human face-to-face communication is multimodal: it comprises speech as well as visual
cues, such as articulatory and limb gestures. In the current study, we assess how iconic …

Hearing and seeing meaning in speech and gesture: Insights from brain and behaviour

A Özyürek - … Transactions of the Royal Society B …, 2014 - royalsocietypublishing.org
As we speak, we use not only the arbitrary form–meaning mappings of the speech channel
but also motivated form–meaning correspondences, ie iconic gestures that accompany …

Comprehension in-situ: how multimodal information shapes language processing

Y Zhang - 2022 - discovery.ucl.ac.uk
The human brain supports communication in dynamic face-to-face environments where
spoken words are embedded in linguistic discourse and accompanied by multimodal cues …

Comprehensibility and neural substrate of communicative gestures in severe aphasia

K Hogrefe, W Ziegler, N Weidinger, G Goldenberg - Brain and Language, 2017 - Elsevier
Communicative gestures can compensate incomprehensibility of oral speech in severe
aphasia, but the brain damage that causes aphasia may also have an impact on the …

[PDF][PDF] Word predictability, prosody, gesture and mouth movements in face-to-face language comprehension

Y Zhang, D Frassinelli, J Tuomainen, JI Skipper… - …, 2020 - pdfs.semanticscholar.org
The ecology of human language is face-to-face interaction, comprising cues, like prosody,
cospeech gestures, and mouth movements. Yet, the multimodal context is usually stripped …