This paper describes a method for lip reading of hearing impaired persons. The term lip
reading refers to recognizing the spoken words using visual speech information such as lip …

We study the problem of mapping from acoustic to visual speech with the goal of generating
accurate, perceptually natural speech animation automatically from an audio speech signal …

Prediction plays a key role in recent computational models of the brain and it has been
suggested that the brain constantly makes multisensory spatiotemporal predictions. Inspired …

Algorithms for 3D head pose and facial expression tracking using a single camera
(monocular image sequences) is presented in this paper. The proposed method is based on …

The relationship between acoustic and visual speech is important for understanding speech
perception, but it also forms the basis behind a type of facial animator, which can predict …

This paper presents a hierarchical animation method for transferring facial expressions
extracted from a performance video to different facial sketches. Without any expression …

This paper proposes a technique for synthesizing a pixel-based photo-realistic talking face
animation using two-step synthesis with HMMs and DNNs. We introduce facial expression …

In this paper, a system for speech-driven animation of generic 3D head models is presented.
The system is based on the inversion of a joint Audio-Visual Hidden Markov Model to …

A comprehensive system for facial animation of generic 3D head models driven by speech is
presented in this article. In the training stage, audio-visual information is extracted from …

This project investigates the use of artificial neural networks for visual speech synthesis. The
objective was to produce a framework for animated chat bots in Swedish. A survey of the …