With the progression of deep-learning techniques, digital media recording and synthesis
media generation have become exceptionally easy. Due to open access of user-friendly …

We present AdVerb, a novel audio-visual dereverberation framework that uses visual cues
in addition to the reverberant sound to estimate clean audio. Although audio-only …

Deepfake technology has advanced a lot, but it is a double-sided sword for the community.
One can use it for beneficial purposes, such as restoring vintage content in old movies, or for …

This paper focuses on designing a noise-robust end-to-end Audio-Visual Speech
Recognition (AVSR) system. To this end, we propose Visual Context-driven Audio Feature …

Speech enhancement on mobile devices is a very challenging task due to the complex
environmental noises. Recent works using lip-induced ultrasound signals for speech …

Due to the detrimental impact of noise on the conventional audio speech recognition (ASR)
task, audio-visual speech recognition~(AVSR) has been proposed by incorporating both …

Audio-visual speech enhancement (AV-SE) aims to enhance degraded speech along with
extra visual information such as lip videos, and has been shown to be more effective than …

Understanding speech becomes a demanding task when the environment is noisy.
Comprehension of speech in noise can be substantially improved by looking at the …

Music source separation from a sound mixture remains a big challenge because there often
exist heavy overlaps and interactions among similar music signals. In order to correctly …

In this paper, we systematically study the audio-visual speech separation task in a multi-
speaker scenario. Given the facial information of each speaker, the goal of this task is to …