Jali: an animator-centric viseme model for expressive lip synchronization

P Edwards, C Landreth, E Fiume, K Singh - ACM Transactions on …, 2016 - dl.acm.org
The rich signals we extract from facial expressions imposes high expectations for the
science and art of facial animation. While the advent of high-resolution performance capture …

Speech-driven 3D facial animation with implicit emotional awareness: A deep learning approach

HX Pham, S Cheung… - Proceedings of the IEEE …, 2017 - openaccess.thecvf.com
We introduce a long short-term memory recurrent neural network (LSTM-RNN) approach for
real-time facial animation, which automatically estimates head rotation and facial action unit …

End-to-end learning for 3d facial animation from speech

HX Pham, Y Wang, V Pavlovic - Proceedings of the 20th ACM …, 2018 - dl.acm.org
We present a deep learning framework for real-time speech-driven 3D facial animation from
speech audio. Our deep neural network directly maps an input sequence of speech …

A practical and configurable lip sync method for games

Y Xu, AW Feng, S Marsella, A Shapiro - Proceedings of Motion on …, 2013 - dl.acm.org
We demonstrate a lip animation (lip sync) algorithm for real-time applications that can be
used to generate synchronized facial movements with audio generated from natural speech …

Audio2face: Generating speech/face animation from single audio with attention-based bidirectional lstm networks

G Tian, Y Yuan, Y Liu - 2019 IEEE international conference on …, 2019 - ieeexplore.ieee.org
We propose an end to end deep learning approach for generating real-time facial animation
from just audio. Specifically, our deep architecture employs deep bidirectional long short …

Evaluating perceived trust from procedurally animated gaze

A Normoyle, JB Badler, T Fan, NI Badler… - Proceedings of Motion …, 2013 - dl.acm.org
Adventure role playing games (RPGs) provide players with increasingly expansive worlds,
compelling storylines, and meaningful fictional character interactions. Despite the fast …

Speech-driven facial animation with spectral gathering and temporal attention

Y Chai, Y Weng, L Wang, K Zhou - Frontiers of Computer Science, 2022 - Springer
In this paper, we present an efficient algorithm that generates lip-synchronized facial
animation from a given vocal audio clip. By combining spectral-dimensional bidirectional …

Web-based live speech-driven lip-sync

G Llorach, A Evans, J Blat, G Grimm… - 2016 8th International …, 2016 - ieeexplore.ieee.org
Virtual characters are an integral part of many games and virtual worlds. The ability to
accurately synchronize lip movement to audio speech is an important aspect in the …

Vocal: Vowel and consonant layering for expressive animator-centric singing animation

Y Pan, C Landreth, E Fiume, K Singh - SIGGRAPH Asia 2022 …, 2022 - dl.acm.org
Singing and speaking are two fundamental forms of human communication. From a
modeling perspective however, speaking can be seen as a subset of singing. We present …

Apparatus and method for performing motion capture using shutter synchronization

G LaSalle, R van der Laan, SG Periman… - US Patent …, 2009 - Google Patents
(*) Notice: Subject to any disclaimer, the term of this OTHER PUBLICATIONS patent is
extended or adjusted under 35 USC 154 (b) by 576 days. Guenter et al.,“Making Faces” …