DiffSpeaker: Speech-Driven 3D Facial Animation with Diffusion Transformer

Z Ma, X Zhu, G Qi, C Qian, Z Zhang, Z Lei - arXiv preprint arXiv …, 2024 - arxiv.org
Speech-driven 3D facial animation is important for many multimedia applications. Recent
work has shown promise in using either Diffusion models or Transformer architectures for …

EmoFace: Emotion-Content Disentangled Speech-Driven 3D Talking Face with Mesh Attention

Y Lin, L Peng, J Hu, X Li, W Kang, S Lei, X Wu… - arXiv preprint arXiv …, 2024 - arxiv.org
The creation of increasingly vivid 3D virtual digital humans has become a hot topic in recent
years. Currently, most speech-driven work focuses on training models to learn the …

ProbTalk3D: Non-Deterministic Emotion Controllable Speech-Driven 3D Facial Animation Synthesis Using VQ-VAE

S Wu, KI Haque, Z Yumak - arXiv preprint arXiv:2409.07966, 2024 - arxiv.org
Audio-driven 3D facial animation synthesis has been an active field of research with
attention from both academia and industry. While there are promising results in this area …

P‐2.3: Development Prospects and Current Status of Deep Learning Neural Network‐based Facial Capture in the Metaverse Field

H Qin, C Wang, Z Li, L Wang - SID Symposium Digest of …, 2024 - Wiley Online Library
The intricate physiological composition of the human face facilitates the manifestation of
diverse facial expressions, serving as a conduit for the conveyance of emotions, cognitive …