Learning in audio-visual context: A review, analysis, and new perspective

Y Wei, D Hu, Y Tian, X Li - arXiv preprint arXiv:2208.09579, 2022 - arxiv.org
Sight and hearing are two senses that play a vital role in human communication and scene
understanding. To mimic human perception ability, audio-visual learning, aimed at …

Deep multimodal emotion recognition on human speech: A review

P Koromilas, T Giannakopoulos - Applied Sciences, 2021 - mdpi.com
This work reviews the state of the art in multimodal speech emotion recognition
methodologies, focusing on audio, text and visual information. We provide a new …

Cross-subject multimodal emotion recognition based on hybrid fusion

Y Cimtay, E Ekmekcioglu, S Caglar-Ozhan - IEEE Access, 2020 - ieeexplore.ieee.org
Multimodal emotion recognition has gained traction in affective computing research
community to overcome the limitations posed by the processing a single form of data and to …

Deep learning for robust feature generation in audiovisual emotion recognition

Y Kim, H Lee, EM Provost - 2013 IEEE international conference …, 2013 - ieeexplore.ieee.org
Automatic emotion recognition systems predict high-level affective content from low-level
human-centered signal cues. These systems have seen great improvements in classification …

Emotion recognition using a hierarchical binary decision tree approach

CC Lee, E Mower, C Busso, S Lee, S Narayanan - Speech communication, 2011 - Elsevier
Automated emotion state tracking is a crucial element in the computational study of human
communication behaviors. It is important to design robust and reliable emotion recognition …

Behavioral signal processing: Deriving human behavioral informatics from speech and language

S Narayanan, PG Georgiou - Proceedings of the IEEE, 2013 - ieeexplore.ieee.org
The expression and experience of human behavior are complex and multimodal and
characterized by individual and contextual heterogeneity and variability. Speech and …

A framework for automatic human emotion classification using emotion profiles

E Mower, MJ Matarić… - IEEE Transactions on …, 2010 - ieeexplore.ieee.org
Automatic recognition of emotion is becoming an increasingly important component in the
design process for affect-sensitive human-machine interaction (HMI) systems. Well …

Survey on audiovisual emotion recognition: databases, features, and data fusion strategies

CH Wu, JC Lin, WL Wei - APSIPA transactions on signal and …, 2014 - cambridge.org
Emotion recognition is the ability to identify what people would think someone is feeling from
moment to moment and understand the connection between his/her feelings and …

[PDF][PDF] Context-sensitive multimodal emotion recognition from speech and facial expression using bidirectional lstm modeling

M Wöllmer, A Metallinou, F Eyben, B Schuller… - 2010 - opus.bibliothek.uni-augsburg.de
In this paper, we apply a context-sensitive technique for multimodal emotion recognition
based on feature-level fusion of acoustic and visual cues. We use bidirectional Long Short …

Context-sensitive learning for enhanced audiovisual emotion classification

A Metallinou, M Wollmer, A Katsamanis… - IEEE Transactions …, 2012 - ieeexplore.ieee.org
Human emotional expression tends to evolve in a structured manner in the sense that
certain emotional evolution patterns, ie, anger to anger, are more probable than others, eg …