State of the art on monocular 3D face reconstruction, tracking, and applications

M Zollhöfer, J Thies, P Garrido, D Bradley… - Computer graphics …, 2018 - Wiley Online Library
The computer graphics and vision communities have dedicated long standing efforts in
building computerized tools for reconstructing, tracking, and analyzing human faces based …

Makelttalk: speaker-aware talking-head animation

Y Zhou, X Han, E Shechtman, J Echevarria… - ACM Transactions On …, 2020 - dl.acm.org
We present a method that generates expressive talking-head videos from a single facial
image with audio as the only input. In contrast to previous attempts to learn direct mappings …

[PDF][PDF] Learning a model of facial shape and expression from 4D scans.

T Li, T Bolkart, MJ Black, H Li, J Romero - ACM Trans. Graph., 2017 - 3dvar.com
Learning a model of facial shape and expression from 4D scans Page 1 Learning a model
of facial shape and expression from 4D scans TIANYE LI∗†, University of Southern …

Lipsync3d: Data-efficient learning of personalized 3d talking faces from video using pose and lighting normalization

A Lahiri, V Kwatra, C Frueh, J Lewis… - Proceedings of the …, 2021 - openaccess.thecvf.com
In this paper, we present a video-based learning framework for animating personalized 3D
talking faces from audio. We introduce two training-time data normalizations that significantly …

3d morphable face models—past, present, and future

B Egger, WAP Smith, A Tewari, S Wuhrer… - ACM Transactions on …, 2020 - dl.acm.org
In this article, we provide a detailed survey of 3D Morphable Face Models over the 20 years
since they were first proposed. The challenges in building and applying these models …

[PDF][PDF] Practice and theory of blendshape facial models.

JP Lewis, K Anjyo, T Rhee, M Zhang… - … (State of the Art …, 2014 - scribblethink.org
Abstract “Blendshapes”, a simple linear model of facial expression, is the prevalent
approach to realistic facial animation. It has driven animated characters in Hollywood films …

Statistical modeling of craniofacial shape and texture

H Dai, N Pears, W Smith, C Duncan - International Journal of Computer …, 2020 - Springer
We present a fully-automatic statistical 3D shape modeling approach and apply it to a large
dataset of 3D images, the Headspace dataset, thus generating the first public shape-and …

Continuous landmark detection with 3d queries

P Chandran, G Zoss, P Gotardo… - Proceedings of the …, 2023 - openaccess.thecvf.com
Neural networks for facial landmark detection are notoriously limited to a fixed set of
landmarks in a dedicated layout, which must be specified at training time. Dedicated …

Phace: Physics-based face modeling and animation

AE Ichim, P Kadleček, L Kavan, M Pauly - ACM Transactions on …, 2017 - dl.acm.org
We present a novel physics-based approach to facial animation. Contrary to commonly used
generative methods, our solution computes facial expressions by minimizing a set of non …

An anatomically-constrained local deformation model for monocular face capture

C Wu, D Bradley, M Gross, T Beeler - ACM transactions on graphics …, 2016 - dl.acm.org
We present a new anatomically-constrained local face model and fitting approach for
tracking 3D faces from 2D motion data in very high quality. In contrast to traditional global …