Visual influences on auditory behavioral, neural, and perceptual processes: a review

C Opoku-Baah, AM Schoenhaut, SG Vassall… - Journal of the …, 2021 - Springer
In a naturalistic environment, auditory cues are often accompanied by information from other
senses, which can be redundant with or complementary to the auditory information …

[HTML][HTML] Natural infant-directed speech facilitates neural tracking of prosody

KH Menn, C Michel, L Meyer, S Hoehl, C Männel - NeuroImage, 2022 - Elsevier
Infants prefer to be addressed with infant-directed speech (IDS). IDS benefits language
acquisition through amplified low-frequency amplitude modulations. It has been reported …

Neural tracking in infancy predicts language development in children with and without family history of autism

KH Menn, EK Ward, R Braukmann… - Neurobiology of …, 2022 - direct.mit.edu
During speech processing, neural activity in non-autistic adults and infants tracks the speech
envelope. Recent research in adults indicates that this neural tracking relates to linguistic …

Neural tracking of continuous acoustics: properties, speech‐specificity and open questions

B Zoefel, A Kösem - European Journal of Neuroscience, 2024 - Wiley Online Library
Human speech is a particularly relevant acoustic stimulus for our species, due to its role of
information transmission during communication. Speech is inherently a dynamic signal, and …

Short report on the effects of SARS-CoV-2 face protective equipment on verbal communication

E Muzzi, C Chermaz, V Castro, M Zaninoni… - European Archives of …, 2021 - Springer
Objective To predict the impact of face personal protective equipment on verbal
communication during the SARS-CoV-2 pandemic. Design We assessed the effect of …

Crossmodal phase reset and evoked responses provide complementary mechanisms for the influence of visual speech in auditory cortex

P Mégevand, MR Mercier, DM Groppe… - Journal of …, 2020 - Soc Neuroscience
Natural conversation is multisensory: when we can see the speaker's face, visual speech
cues improve our comprehension. The neuronal mechanisms underlying this phenomenon …

“Entraining” to speech, generating language?

L Meyer, Y Sun, AE Martin - Language, Cognition and …, 2020 - Taylor & Francis
Could meaning be read from acoustics, or from the refraction rate of pyramidal cells
innervated by the cochlea, everyone would be an omniglot. Speech does not contain …

[HTML][HTML] A representation of abstract linguistic categories in the visual system underlies successful lipreading

AR Nidiffer, CZ Cao, A O'Sullivan, EC Lalor - NeuroImage, 2023 - Elsevier
There is considerable debate over how visual speech is processed in the absence of sound
and whether neural activity supporting lipreading occurs in visual brain areas. Much of the …

Lip2Vec: Efficient and Robust Visual Speech Recognition via Latent-to-Latent Visual to Audio Representation Mapping

YAD Djilali, S Narayan, H Boussaid… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Visual Speech Recognition (VSR) differs from the common perception tasks as it
requires deeper reasoning over the video sequence, even by human experts. Despite the …

[PDF][PDF] Unsupervised vision-language grammar induction with shared structure modeling

B Wan, W Han, Z Zheng, T Tuytelaars - Proceedings ICLR 2022, 2022 - lirias.kuleuven.be
We introduce a new task, unsupervised vision-language (VL) grammar induction. Given an
image-caption pair, the goal is to extract a shared hierarchical structure for both image and …