Active speaker detection is a challenging task in audio-visual scenarios, with the aim to
detect who is speaking in one or more speaker scenarios. This task has received …

In a noisy conversation environment such as a dinner party, people often exhibit selective
auditory attention, or the ability to focus on a particular speaker while tuning out others …

In active speaker detection (ASD), we would like to detect whether an on-screen person is
speaking based on audio-visual cues. Previous studies have primarily focused on modeling …

Nowadays, the large amount of audio-visual content available has fostered the need to
develop new robust automatic speaker diarization systems to analyse and characterise it …

The goal of this work is Active Speaker Detection (ASD), a task to determine whether a
person is speaking or not in a series of video frames. Previous works have dealt with the …

Active speaker detection in videos addresses associating a source face, visible in the video
frames, with the underlying speech in the audio modality. The two primary sources of …

Gaze following and social gaze prediction are fundamental tasks providing insights into
human communication behaviors, intent, and social interactions. Most previous approaches …

Future augmented reality devices have the capacity to enhance human perception and
provide assistive functions in complex communication scenarios. Active speaker detection …

In this study, we present an end-to-end framework for active speaker detection to achieve
robust performance in challenging scenarios with multiple speakers. In contrast to recent …

The task of joint dialogue act recognition (DAR) and sentiment classification (DSC) aims to
predict both the act and sentiment labels of each utterance in a dialogue. Existing methods …