We present a machine learning technique for driving 3D facial animation by audio input in
real time and with low latency. Our deep neural network learns a mapping from input …

Abstract “Blendshapes”, a simple linear model of facial expression, is the prevalent
approach to realistic facial animation. It has driven animated characters in Hollywood films …

Face Transfer is a method for mapping videorecorded performances of one individual to
facial animations of another. It extracts visemes (speech-related mouth articulations) …

We built an anatomically accurate model of facial musculature, passive tissue and
underlying skeletal structure using volumetric data acquired from a living male subject. The …

We demonstrate a method for generating a 3D virtual character performance from the audio
signal by inferring the acoustic and semantic properties of the utterance. Through a prosodic …

Speech-driven facial motion synthesis is a well explored research topic. However, little has
been done to model expressive visual behavior during speech. We address this issue using …

Motion capture-based facial animation has recently gained popularity in many applications,
such as movies, video games, and human-computer interface designs. With the use of …

We demonstrate a lip animation (lip sync) algorithm for real-time applications that can be
used to generate synchronized facial movements with audio generated from natural speech …

Synthesizing expressive facial animation is a very challenging topic within the graphics
community. In this paper, we present an expressive facial animation synthesis system …

We present a physically based system for creating animations of novel words and phrases
from text and audio input based on the analysis of motion captured speech examples …