Speech enhancement and speech separation are two related tasks, whose purpose is to
extract either one or more target speech signals, respectively, from a mixture of sounds …

Dense video captioning aims to localize and describe important events in untrimmed videos.
Existing methods mainly tackle this task by exploiting only visual features, while completely …

Recent advances in visually-induced audio generation are based on sampling short, low-
fidelity, and one-class sounds. Moreover, sampling 1 second of audio from the state-of-the …

Recent progress in deep learning has enabled many advances in sound separation and
visual scene understanding. However, extracting sound sources which are apparent in …

Current audio-visual separation methods share a standard architecture design where an
audio encoder-decoder network is fused with visual encoding features at the encoder …

Audio-visual correlation learning aims to capture essential correspondences and
understand natural phenomena between audio and video. With the rapid growth of deep …

Existing machine learning research has achieved promising results in monaural audio-
visual separation (MAVS). However, most MAVS methods purely consider what the sound …

In this paper, we perform audio-visual sound source separation, ie to separate component
audios from a mixture based on the videos of sound sources. Moreover, we aim to pinpoint …

The objective of this paper is to perform visual sound separation: i) we study visual sound
separation on spectrograms of different temporal resolutions; ii) we propose a new light yet …

The task of isolating a target singing voice in music videos has useful applications. In this
work, we explore the single-channel singing voice separation problem from a multimodal …