High-fidelity generalized emotional talking face generation with multi-modal emotion space learning

C Xu, J Zhu, J Zhang, Y Han, W Chu… - Proceedings of the …, 2023 - openaccess.thecvf.com
Recently, emotional talking face generation has received considerable attention. However,
existing methods only adopt one-hot coding, image, or audio as emotion conditions, thus …

Hyperreenact: one-shot reenactment via jointly learning to refine and retarget faces

S Bounareli, C Tzelepis, V Argyriou… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this paper, we present our method for neural face reenactment, called HyperReenact, that
aims to generate realistic talking head images of a source identity, driven by a target facial …

Portraitbooth: A versatile portrait model for fast identity-preserved personalization

X Peng, J Zhu, B Jiang, Y Tai, D Luo… - Proceedings of the …, 2024 - openaccess.thecvf.com
Recent advancements in personalized image generation using diffusion models have been
noteworthy. However existing methods suffer from inefficiencies due to the requirement for …

Blendface: Re-designing identity encoders for face-swapping

K Shiohara, X Yang, T Taketomi - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
The great advancements of generative adversarial networks and face recognition models in
computer vision have made it possible to swap identities on images from single sources …

Talking head generation with probabilistic audio-to-visual diffusion priors

Z Yu, Z Yin, D Zhou, D Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
We introduce a novel framework for one-shot audio-driven talking head generation. Unlike
prior works that require additional driving sources for controlled synthesis in a deterministic …

[HTML][HTML] Video and audio deepfake datasets and open issues in deepfake technology: being ahead of the curve

Z Akhtar, TL Pendyala, VS Athmakuri - Forensic Sciences, 2024 - mdpi.com
The revolutionary breakthroughs in Machine Learning (ML) and Artificial Intelligence (AI) are
extensively being harnessed across a diverse range of domains, eg, forensic science …

Deepfake generation and detection: A benchmark and survey

G Pei, J Zhang, M Hu, Z Zhang, C Wang, Y Wu… - arXiv preprint arXiv …, 2024 - arxiv.org
Deepfake is a technology dedicated to creating highly realistic facial images and videos
under specific conditions, which has significant application potential in fields such as …

Face-Adapter for Pre-trained Diffusion Models with Fine-Grained ID and Attribute Control

Y Han, J Zhu, K He, X Chen, Y Ge, W Li, X Li… - … on Computer Vision, 2025 - Springer
Current face reenactment and swapping methods mainly rely on GAN frameworks, but
recent focus has shifted to pre-trained diffusion models for their superior generation …

Towards a simultaneous and granular identity-expression control in personalized face generation

R Liu, B Ma, W Zhang, Z Hu, C Fan… - Proceedings of the …, 2024 - openaccess.thecvf.com
In human-centric content generation the pre-trained text-to-image models struggle to
produce user-wanted portrait images which retain the identity of individuals while exhibiting …

Reinforced disentanglement for face swapping without skip connection

X Ren, X Chen, P Yao, HY Shum… - Proceedings of the …, 2023 - openaccess.thecvf.com
The SOTA face swap models still suffer the problem of either target identity (ie, shape) being
leaked or the target non-identity attributes (ie, background, hair) failing to be fully preserved …