… The visual and audio information usually jointly help human’s recognition. Motivated by the
… information separating sound sources better, we intend to guide sound source separation …

… for video-guided audio source separation from an acoustic mixture that can also predict the
direction of motion of the sound source. … To achieve audio source separation, we propose a …

… audio-visual classifier per source by utilizing the powerful representations obtained from
unsupervised pre-training of the audio source separation … describes video-guided attention …

… Our model performs a monaural (single-microphone) video guided speaker separation. “Fig…
Rahtu, “Visually guided sound source separation and localization using self-supervised …

… separated features and the order of clean audio labels, we employ distinct training strategies
for the video-guided … [18, 48] combined with the scale-invariant signal-to-distortion ratio (SI-…

… audio signal as an important cue for restoring the corrupted frame. Given the prior information
of audio-visual correlation that AV-Net provides, we propose two novel audio-visual losses …

… (1) We supplement a profound analysis on the factors that influence sound source
localization, motivating us to embed sound source localization as an auxiliary task for saliency …

… several audio-only sound source separation baselines including RPCA, HPSS, and NMF
methods. At the same time, we also compare our method with the sound source separation …

… Specifically, this paper focuses on the problem of audio-visual speech … audio signal is known
as audio inpainting [1]. Carrying out such a restoration for long segments of corrupted audio …

… 3) We conduct additional experiments on both sound source localization and saliency
prediction, eg, comparing with more methods, and evaluating on more databases, as well as …