Deepfakes generation and detection: State-of-the-art, open challenges, countermeasures, and way forward

M Masood, M Nawaz, KM Malik, A Javed, A Irtaza… - Applied …, 2023 - Springer
Easy access to audio-visual content on social media, combined with the availability of
modern tools such as Tensorflow or Keras, and open-source trained models, along with …

The creation and detection of deepfakes: A survey

Y Mirsky, W Lee - ACM computing surveys (CSUR), 2021 - dl.acm.org
Generative deep learning algorithms have progressed to a point where it is difficult to tell the
difference between what is real and what is fake. In 2018, it was discovered how easy it is to …

End-to-end reconstruction-classification learning for face forgery detection

J Cao, C Ma, T Yao, S Chen… - Proceedings of the …, 2022 - openaccess.thecvf.com
Existing face forgery detectors mainly focus on specific forgery patterns like noise
characteristics, local textures, or frequency statistics for forgery detection. This causes …

Multi-attentional deepfake detection

H Zhao, W Zhou, D Chen, T Wei… - Proceedings of the …, 2021 - openaccess.thecvf.com
Face forgery by deepfake is widely spread over the internet and has raised severe societal
concerns. Recently, how to detect such forgery contents has become a hot research topic …

Pose-controllable talking face generation by implicitly modularized audio-visual representation

H Zhou, Y Sun, W Wu, CC Loy… - Proceedings of the …, 2021 - openaccess.thecvf.com
While accurate lip synchronization has been achieved for arbitrary-subject audio-driven
talking face generation, the problem of how to efficiently drive the head pose remains …

Depth-aware generative adversarial network for talking head video generation

FT Hong, L Zhang, L Shen… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Talking head video generation aims to produce a synthetic human face video that contains
the identity and pose information respectively from a given source image and a driving …

One-shot free-view neural talking-head synthesis for video conferencing

TC Wang, A Mallya, MY Liu - Proceedings of the IEEE/CVF …, 2021 - openaccess.thecvf.com
We propose a neural talking-head video synthesis model and demonstrate its application to
video conferencing. Our model learns to synthesize a talking-head video using a source …

Expressive talking head generation with granular audio-visual control

B Liang, Y Pan, Z Guo, H Zhou… - Proceedings of the …, 2022 - openaccess.thecvf.com
Generating expressive talking heads is essential for creating virtual humans. However,
existing one-or few-shot methods focus on lip-sync and head motion, ignoring the emotional …

Styleheat: One-shot high-resolution editable talking face generation via pre-trained stylegan

F Yin, Y Zhang, X Cun, M Cao, Y Fan, X Wang… - European conference on …, 2022 - Springer
One-shot talking face generation aims at synthesizing a high-quality talking face video from
an arbitrary portrait image, driven by a video or an audio segment. In this work, we provide a …

Pirenderer: Controllable portrait image generation via semantic neural rendering

Y Ren, G Li, Y Chen, TH Li… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Generating portrait images by controlling the motions of existing faces is an important task of
great consequence to social media industries. For easy use and intuitive control …