Audio-visual speech and gesture recognition by sensors of mobile devices

D Ryumin, D Ivanko, E Ryumina - Sensors, 2023 - mdpi.com
Audio-visual speech recognition (AVSR) is one of the most promising solutions for reliable
speech recognition, particularly when audio is corrupted by noise. Additional visual …

Machine learning applied to digital phenotyping: A systematic literature review and taxonomy

MP dos Santos, WF Heckler, RS Bavaresco… - Computers in Human …, 2024 - Elsevier
Health conditions, encompassing both physical and mental aspects, hold an influence that
extends beyond the individual. These conditions affect personal well-being, relationships …

Review and analysis of patients' body language from an artificial intelligence perspective

S Turaev, S Al-Dabet, A Babu, Z Rustamov… - IEEE …, 2023 - ieeexplore.ieee.org
Body language is a nonverbal communication process consisting of movements, postures,
gestures, and expressions of the body or body parts. Body language expresses human …

Semi-structural interview-based Chinese multimodal depression corpus towards automatic preliminary screening of depressive disorders

B Zou, J Han, Y Wang, R Liu, S Zhao… - IEEE Transactions …, 2022 - ieeexplore.ieee.org
Depression is a common psychiatric disorder worldwide. However, in China, a considerable
number of patients with depression are not diagnosed, and most of them are not aware of …

Facial image analysis for automated suicide risk detection with deep neural networks

AEE Rashed, AEM Atwa, A Ahmed, M Badawy… - Artificial Intelligence …, 2024 - Springer
Accurately assessing suicide risk is a critical concern in mental health care. Traditional
methods, which often rely on self-reporting and clinical interviews, are limited by their …

Exploring Emotions Through Co-speech Gestures: The Caveats and New Directions

Z Aslan, D Özer, T Göksun - Emotion Review, 2024 - journals.sagepub.com
Co-speech hand gestures offer a rich avenue for research into studying emotion
communication because they serve as both prominent expressive bodily cues and an …

Is there a correlation between the use of representational gestures and self-adaptors?

E Nicoladis, A Aneja, J Sidhu, A Dhanoa - Journal of Nonverbal Behavior, 2022 - Springer
There are individual differences between people in their production of representational
gestures, hand movements that represent the referent. In the present study, we test whether …

Promoting Fairness and Diversity in Speech Datasets for Mental Health and Neurological Disorders Research

E Mancini, A Tanevska, A Galassi, A Galatolo… - arXiv preprint arXiv …, 2024 - arxiv.org
Current research in machine learning and artificial intelligence is largely centered on
modeling and performance evaluation, less so on data collection. However, recent research …

Prosody, gesture, and self-adaptors: A case study of Autism Spectrum Disorder for large corpora collection

V Saccone, G Cantalini, M Moneglia - CHIMERA, 2023 - flore.unifi.it
Individuals with Autism Spectrum Disorder (ASD) display distinctive speech patterns and
bodily movements. This pilot study examines spontaneous interactions between an …

Lucia: A Temporal Computing Platform for Contextual Intelligence

W Lin, J Shen - arXiv preprint arXiv:2411.12778, 2024 - arxiv.org
The rapid evolution of artificial intelligence, especially through multi-modal large language
models, has redefined user interactions, enabling responses that are contextually rich and …