We present a framework for modeling interactional communication in dyadic conversations:
given multimodal inputs of a speaker, we autoregressively output multiple possibilities of …

We present a framework for generating appropriate facial responses from a listener in
dyadic social interactions based on the speaker's words. Given an input transcription of the …

We present ZeroEGGS, a neural network framework for speech‐driven gesture generation
with zero‐shot style control by example. This means style can be controlled via only a short …

Artificial-intelligence (AI) powered conversational (CAI) agents have been growing in
popularity. Like human personality, CAI agent personality can also impact the relationship …

The World Health Organization recommends that employers take action to protect and
promote mental well-being at work. However, the extent to which these recommended …

Co‐speech gestures are a vital ingredient in making virtual agents more human‐like and
engaging. Automatically generated gestures based on speech‐input often lack realistic and …

The Multimodal Sentiment Analysis Challenge (MuSe) 2024 addresses two contemporary
multimodal affect and sentiment analysis problems: In the Social Perception Sub-Challenge …

We introduce a video framework for modeling the association between verbal and non-
verbal communication during dyadic conversation. Given the input speech of a speaker, our …

The portrayed personality of virtual characters and agents is understood to influence how we
perceive and engage with digital applications. Understanding how the features of speech …

We present S 3, a novel approach to generating expressive, animator-centric 3D head and
eye animation of characters in conversation. Given speech audio, a Directorial script and a …