Audio-driven facial animation by joint end-to-end learning of pose and emotion
We present a machine learning technique for driving 3D facial animation by audio input in
real time and with low latency. Our deep neural network learns a mapping from input …
real time and with low latency. Our deep neural network learns a mapping from input …
[PDF][PDF] Practice and theory of blendshape facial models.
Abstract “Blendshapes”, a simple linear model of facial expression, is the prevalent
approach to realistic facial animation. It has driven animated characters in Hollywood films …
approach to realistic facial animation. It has driven animated characters in Hollywood films …
Face transfer with multilinear models
Face Transfer is a method for mapping videorecorded performances of one individual to
facial animations of another. It extracts visemes (speech-related mouth articulations) …
facial animations of another. It extracts visemes (speech-related mouth articulations) …
Automatic determination of facial muscle activations from sparse motion capture marker data
We built an anatomically accurate model of facial musculature, passive tissue and
underlying skeletal structure using volumetric data acquired from a living male subject. The …
underlying skeletal structure using volumetric data acquired from a living male subject. The …
Virtual character performance from speech
We demonstrate a method for generating a 3D virtual character performance from the audio
signal by inferring the acoustic and semantic properties of the utterance. Through a prosodic …
signal by inferring the acoustic and semantic properties of the utterance. Through a prosodic …
Expressive speech-driven facial animation
Speech-driven facial motion synthesis is a well explored research topic. However, little has
been done to model expressive visual behavior during speech. We address this issue using …
been done to model expressive visual behavior during speech. We address this issue using …
Mood swings: expressive speech animation
E Chuang, C Bregler - ACM Transactions on Graphics (TOG), 2005 - dl.acm.org
Motion capture-based facial animation has recently gained popularity in many applications,
such as movies, video games, and human-computer interface designs. With the use of …
such as movies, video games, and human-computer interface designs. With the use of …
A practical and configurable lip sync method for games
We demonstrate a lip animation (lip sync) algorithm for real-time applications that can be
used to generate synchronized facial movements with audio generated from natural speech …
used to generate synchronized facial movements with audio generated from natural speech …
Expressive facial animation synthesis by learning speech coarticulation and expression spaces
Synthesizing expressive facial animation is a very challenging topic within the graphics
community. In this paper, we present an expressive facial animation synthesis system …
community. In this paper, we present an expressive facial animation synthesis system …
[PDF][PDF] Simulating speech with a physics-based facial muscle model
We present a physically based system for creating animations of novel words and phrases
from text and audio input based on the analysis of motion captured speech examples …
from text and audio input based on the analysis of motion captured speech examples …