This article provides a detailed review of recent advances in audio-visual speech
recognition (AVSR) methods that have been developed over the last decade (2013–2023) …

Audio-visual speech recognition (AVSR) is one of the most promising solutions for reliable
speech recognition, particularly when audio is corrupted by noise. Additional visual …

Many researchers have been seeking robust emotion recognition system for already last two
decades. It would advance computer systems to a new level of interaction, providing much …

Abstract A Compound Expression Recognition (CER) as a subfield of affective computing is
a novel task in intelligent human-computer interaction and multimodal user interfaces. We …

Recognition of emotions and sentiment (affective states) from human audio–visual
information is widely used in healthcare, education, entertainment, and other fields; …

Psychological and neurological studies earlier suggested that a personality type can be
determined by the whole face as well as by its sides. This article discusses novel research …

In this paper, we present a new multimodal corpus called Biometric Russian Audio-Visual
Extended MASKS (BRAVEMASKS), which is designed to analyze voice and facial …

In this paper, the personalization of the video-based frame-level facial expression
recognition is studied for multi-user systems if a small amount of short videos are available …

This paper is devoted to tracking dynamics of psycho-emotional state based on analysis of
the user's facial video and voice. We propose a novel technology with personalized acoustic …

We present a new data set for speech emotion recognition (SER) tasks called Dusha. The
corpus contains approximately 350 hours of data, more than 300 000 audio recordings of …