Identity-preserving talking face generation with landmark and appearance priors

W Zhong, C Fang, Y Cai, P Wei… - Proceedings of the …, 2023 - openaccess.thecvf.com
Generating talking face videos from audio attracts lots of research interest. A few person-
specific methods can generate vivid videos but require the target speaker's videos for …

Diffposetalk: Speech-driven stylistic 3d facial animation and head pose generation via diffusion models

Z Sun, T Lv, S Ye, M Lin, J Sheng, YH Wen… - ACM Transactions on …, 2024 - dl.acm.org
The generation of stylistic 3D facial animations driven by speech presents a significant
challenge as it requires learning a many-to-many mapping between speech, style, and the …

Stableface: Analyzing and improving motion stability for talking face generation

J Ling, X Tan, L Chen, R Li, Y Zhang… - IEEE Journal of …, 2023 - ieeexplore.ieee.org
While previous methods for speech-driven talking face generation have shown significant
advances in improving the visual and lip-sync quality of the synthesized videos, they have …

StyleTalk++: A Unified Framework for Controlling the Speaking Styles of Talking Heads

S Wang, Y Ma, Y Ding, Z Hu, C Fan, T Lv… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
Individuals have unique facial expression and head pose styles that reflect their
personalized speaking styles. Existing one-shot talking head methods cannot capture such …

ECAvatar: 3D Avatar Facial Animation with Controllable Identity and Emotion

M Yu, D Pang, Z Kang, Z Sun, T Lv, J Sheng… - Proceedings of the …, 2024 - dl.acm.org
Speech-driven 3D facial animation has attracted considerable attention due to its extensive
applicability across diverse domains. The majority of existing 3D facial animation methods …

OSM-Net: One-to-Many One-shot Talking Head Generation with Spontaneous Head Motions

J Liu, X Wang, X Fu, Y Chai, C Yu… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
One-shot talking head generation has no explicit head movement reference, thus it is difficult
to generate talking heads with head motions. Some existing works only edit the mouth area …

Editing Audio-Driven Talking Head Based on Audio Information

R Lang - 2024 International Joint Conference on Neural …, 2024 - ieeexplore.ieee.org
Editing audio-driven talking head is a relatively new direction in the field of computer vision
and still faces many challenges. First, the existing methods do not fully take into account the …