Visual influences on auditory behavioral, neural, and perceptual processes: a review
In a naturalistic environment, auditory cues are often accompanied by information from other
senses, which can be redundant with or complementary to the auditory information …
senses, which can be redundant with or complementary to the auditory information …
[HTML][HTML] Natural infant-directed speech facilitates neural tracking of prosody
Infants prefer to be addressed with infant-directed speech (IDS). IDS benefits language
acquisition through amplified low-frequency amplitude modulations. It has been reported …
acquisition through amplified low-frequency amplitude modulations. It has been reported …
Neural tracking in infancy predicts language development in children with and without family history of autism
During speech processing, neural activity in non-autistic adults and infants tracks the speech
envelope. Recent research in adults indicates that this neural tracking relates to linguistic …
envelope. Recent research in adults indicates that this neural tracking relates to linguistic …
Neural tracking of continuous acoustics: properties, speech‐specificity and open questions
Human speech is a particularly relevant acoustic stimulus for our species, due to its role of
information transmission during communication. Speech is inherently a dynamic signal, and …
information transmission during communication. Speech is inherently a dynamic signal, and …
Short report on the effects of SARS-CoV-2 face protective equipment on verbal communication
E Muzzi, C Chermaz, V Castro, M Zaninoni… - European Archives of …, 2021 - Springer
Objective To predict the impact of face personal protective equipment on verbal
communication during the SARS-CoV-2 pandemic. Design We assessed the effect of …
communication during the SARS-CoV-2 pandemic. Design We assessed the effect of …
Crossmodal phase reset and evoked responses provide complementary mechanisms for the influence of visual speech in auditory cortex
Natural conversation is multisensory: when we can see the speaker's face, visual speech
cues improve our comprehension. The neuronal mechanisms underlying this phenomenon …
cues improve our comprehension. The neuronal mechanisms underlying this phenomenon …
“Entraining” to speech, generating language?
Could meaning be read from acoustics, or from the refraction rate of pyramidal cells
innervated by the cochlea, everyone would be an omniglot. Speech does not contain …
innervated by the cochlea, everyone would be an omniglot. Speech does not contain …
[HTML][HTML] A representation of abstract linguistic categories in the visual system underlies successful lipreading
There is considerable debate over how visual speech is processed in the absence of sound
and whether neural activity supporting lipreading occurs in visual brain areas. Much of the …
and whether neural activity supporting lipreading occurs in visual brain areas. Much of the …
Lip2Vec: Efficient and Robust Visual Speech Recognition via Latent-to-Latent Visual to Audio Representation Mapping
Abstract Visual Speech Recognition (VSR) differs from the common perception tasks as it
requires deeper reasoning over the video sequence, even by human experts. Despite the …
requires deeper reasoning over the video sequence, even by human experts. Despite the …
[PDF][PDF] Unsupervised vision-language grammar induction with shared structure modeling
We introduce a new task, unsupervised vision-language (VL) grammar induction. Given an
image-caption pair, the goal is to extract a shared hierarchical structure for both image and …
image-caption pair, the goal is to extract a shared hierarchical structure for both image and …