The task of lip synchronization (lip-sync) seeks to match the lips of human faces with
different audio. It has various applications in the film industry as well as for creating virtual …

Dubbed video generation aims to accurately synchronize mouth movements of a given facial
video with driving audio while preserving identity and scene-specific visual dynamics, such …

In the field of speech synthesis, there is a growing emphasis on employing multimodal
speech to enhance robustness. A key challenge in this area is the scarcity of datasets that …

Face-swap DeepFake is an emerging AI-based face forgery technique that can replace the
original face in a video with a generated face of the target identity while retaining consistent …

As one of the crucial elements in human-robot interaction, responsive listening head
generation has attracted considerable attention from researchers. It aims to generate a …

Face-swap DeepFake is an emerging AI-based face forgery technique that can replace the
original face in a video with a generated face of the target identity while retaining consistent …

We introduce GaussianSpeech, a novel approach that synthesizes high-fidelity animation
sequences of photo-realistic, personalized 3D human head avatars from spoken audio. To …

The presented research focuses on the challenging task of creating lip-sync facial videos
that align with a specified target speech segment. A novel deep-learning model has been …

Although existing speech-driven talking face generation methods achieve significant
progress, they are far from real-world application due to the avatar-specific training demand …

Visual dubbing is the process of generating lip motions of an actor in a video to synchronise
with given audio. Recent advances have made progress towards this goal but have not …