Visual Speech Recognition (VSR) is the task of predicting spoken words from silent lip
movements. VSR is regarded as a challenging task because of the insufficient information …

Audio captioning aims to generate text descriptions of audio clips. In the real world, many
objects produce similar sounds. How to accurately recognize ambiguous sounds is a major …

Abstract The Lip Reading Sentences-3 (LRS3) benchmark has primarily been the focus of
intense research in visual speech recognition (VSR) during the last few years. As a result …

This work reviews the dataset-driven advancements that have occurred in the area of lip
motion analysis, particularly visual lip-reading and visual lip motion authentication, in the …

Existing audio-visual cross-modal matching methods focus on mitigating cross-modal
heterogeneity but ignore the impact of intra-class discrepancy of the same identity in …

Learning robust audio representations currently demands extensive datasets of real-world
sound recordings. By applying artificial transformations to these recordings, models can …

Self-supervision has recently shown great promise for learning visual and auditory speech
representations from unlabelled data. In this work, we propose BRAVEn, an extension to the …

Thanks to the rise of deep learning and the availability of large-scale audio-visual
databases, recent advances have been achieved in Visual Speech Recognition (VSR) …

Aerial-view human detection has a large demand for large-scale data to capture more
diverse human appearances compared to ground-view human detection. Therefore …

More than 7,000 known languages are spoken around the world. However, due to the lack
of annotated resources, only a small fraction of them are currently covered by speech …