State of the art on monocular 3D face reconstruction, tracking, and applications

M Zollhöfer, J Thies, P Garrido, D Bradley… - Computer graphics …, 2018 - Wiley Online Library
The computer graphics and vision communities have dedicated long standing efforts in
building computerized tools for reconstructing, tracking, and analyzing human faces based …

Audiovisual speech synthesis: An overview of the state-of-the-art

W Mattheyses, W Verhelst - Speech Communication, 2015 - Elsevier
We live in a world where there are countless interactions with computer systems in every-
day situations. In the most ideal case, this interaction feels as familiar and as natural as the …

Automatic determination of facial muscle activations from sparse motion capture marker data

E Sifakis, I Neverov, R Fedkiw - ACM SIGGRAPH 2005 Papers, 2005 - dl.acm.org
We built an anatomically accurate model of facial musculature, passive tissue and
underlying skeletal structure using volumetric data acquired from a living male subject. The …

[图书][B] The uncanny valley in games and animation

A Tinwell - 2014 - books.google.com
Advances in technology have enabled animators and video game designers to design
increasingly realistic, human-like characters in animation and games. Although it was …

Vdub: Modifying face video of actors for plausible visual alignment to a dubbed audio track

P Garrido, L Valgaerts, H Sarmadi… - Computer graphics …, 2015 - Wiley Online Library
In many countries, foreign movies and TV productions are dubbed, ie, the original voice of
an actor is replaced with a translation that is spoken by a dubbing actor in the country's own …

[PDF][PDF] Dynamic units of visual speech

SL Taylor, M Mahler, BJ Theobald… - Proceedings of the 11th …, 2012 - diglib.eg.org
We present a new method for generating a dynamic, concatenative, unit of visual speech
that can generate realistic visual speech animation. We redefine visemes as temporal units …

Animating blendshape faces by cross-mapping motion capture data

Z Deng, PY Chiang, P Fox, U Neumann - Proceedings of the 2006 …, 2006 - dl.acm.org
Animating 3D faces to achieve compelling realism is a challenging task in the entertainment
industry. Previously proposed face transfer approaches generally require a high-quality …

A practical and configurable lip sync method for games

Y Xu, AW Feng, S Marsella, A Shapiro - Proceedings of Motion on …, 2013 - dl.acm.org
We demonstrate a lip animation (lip sync) algorithm for real-time applications that can be
used to generate synchronized facial movements with audio generated from natural speech …

Expressive facial animation synthesis by learning speech coarticulation and expression spaces

Z Deng, U Neumann, JP Lewis, TY Kim… - IEEE transactions on …, 2006 - ieeexplore.ieee.org
Synthesizing expressive facial animation is a very challenging topic within the graphics
community. In this paper, we present an expressive facial animation synthesis system …

[PDF][PDF] Simulating speech with a physics-based facial muscle model

E Sifakis, A Selle, A Robinson-Mosher… - Proceedings of the 2006 …, 2006 - diglib.eg.org
We present a physically based system for creating animations of novel words and phrases
from text and audio input based on the analysis of motion captured speech examples …