Audio-visual face reenactment

M Agarwal, R Mukhopadhyay… - Proceedings of the …, 2023 - openaccess.thecvf.com
… In this work, we propose a novel face reenactment network, Audio-Visual Face Reenactment
GAN. Our network uses audio-visual cues to reenact a source image according to a driving …

Neural voice puppetry: Audio-driven facial reenactment

J Thies, M Elgharib, A Tewari, C Theobalt… - Computer Vision–ECCV …, 2020 - Springer
… To enable photo-realistic facial reenactment based on audio signals, we employ a 3D face
… a high audio-visual sync, similar to state-of-the-art video-based reenactment approaches …

Parametric implicit face representation for audio-driven facial reenactment

R Huang, P Lai, Y Qin, G Li - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
… shot talking face generation with a high-resolution audio-visualface generation by
adversarially disentangled audio-visual … talking face generation by implicitly modularized …

[PDF][PDF] Vision-based 3D Face Reenactment

S Zhao - 2023 - researchportal.port.ac.uk
… 3D face reenactment, which involves manipulating face images … realistic faces, existing
face reenactment technology still faces … Besides, face reenactment involves a large amount of …

ViCoFace: Learning Disentangled Latent Motion Representations for Visual-Consistent Face Reenactment

J Ling, H Xue, A Tang, R Xie, L Song - ACM Transactions on Multimedia …, 2024 - dl.acm.org
… -subject reenactment. In this work, we propose an effective and cost-efficient face reenactment
… In Table 1 we summarize the key features of representative face reenactment methods …

Hyperreenact: one-shot reenactment via jointly learning to refine and retarget faces

S Bounareli, C Tzelepis, V Argyriou… - Proceedings of the …, 2023 - openaccess.thecvf.com
… Flow-guided one-shot talking face generation with a high-resolution audio-visual dataset.
In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, …

One-shot face reenactment

Y Zhang, S Zhang, Y He, C Li, CC Loy, Z Liu - arXiv preprint arXiv …, 2019 - arxiv.org
… , existing face reenactment methods rely on a set of target faces for learning subject-specific
traits. However, in real-world scenario end-users often only have one target face at hand, …

Talking face generation by adversarially disentangled audio-visual representation

H Zhou, Y Liu, Z Liu, P Luo, X Wang - … of the AAAI conference on artificial …, 2019 - aaai.org
face generation by learning disentangled audio-visual representation. We find that the talking
face … We also demonstrate the learned audio-visual representation is extremely useful for …

Audio-driven neural gesture reenactment with video motion graphs

Y Zhou, J Yang, D Li, J Saito, D Aneja… - Proceedings of the …, 2022 - openaccess.thecvf.com
… To seamlessly connect different clips in the reenactment, we … to find the optimal order of the
reenacted frames. Our system … A large-scale audio-visual dataset for emotional talking-face

Photorealistic audio-driven video portraits

X Wen, M Wang, C Richardt, ZY Chen… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
reenacted face. Finally, we generate a photorealistic video portrait from the reenacted synthetic
face sequence via a neural face … to learn a disentangled audio-visual representation in a …