State of the art on monocular 3D face reconstruction, tracking, and applications

M Zollhöfer, J Thies, P Garrido, D Bradley… - Computer graphics …, 2018 - Wiley Online Library
The computer graphics and vision communities have dedicated long standing efforts in
building computerized tools for reconstructing, tracking, and analyzing human faces based …

Deep video portraits

H Kim, P Garrido, A Tewari, W Xu, J Thies… - ACM transactions on …, 2018 - dl.acm.org
We present a novel approach that enables photo-realistic re-animation of portrait videos
using only an input video. In contrast to existing approaches that are restricted to …

Conerf: Controllable neural radiance fields

K Kania, KM Yi, M Kowalski… - Proceedings of the …, 2022 - openaccess.thecvf.com
We extend neural 3D representations to allow for intuitive and interpretable user control
beyond novel view rendering (ie camera control). We allow the user to annotate which part …

[PDF][PDF] Learning a model of facial shape and expression from 4D scans.

T Li, T Bolkart, MJ Black, H Li, J Romero - ACM Trans. Graph., 2017 - 3dvar.com
Learning a model of facial shape and expression from 4D scans Page 1 Learning a model
of facial shape and expression from 4D scans TIANYE LI∗†, University of Southern …

Total capture: A 3d deformation model for tracking faces, hands, and bodies

H Joo, T Simon, Y Sheikh - Proceedings of the IEEE …, 2018 - openaccess.thecvf.com
We present a unified deformation model for the markerless capture of multiple scales of
human movement, including facial expressions, body motion, and hand gestures. An initial …

[HTML][HTML] Authentic volumetric avatars from a phone scan

C Cao, T Simon, JK Kim, G Schwartz, M Zollhoefer… - 2022 - history.siggraph.org
Creating photorealistic avatars of existing people currently requires extensive person-
specific data capture, which is usually only accessible to the VFX industry and not the …

3d morphable face models—past, present, and future

B Egger, WAP Smith, A Tewari, S Wuhrer… - ACM Transactions on …, 2020 - dl.acm.org
In this article, we provide a detailed survey of 3D Morphable Face Models over the 20 years
since they were first proposed. The challenges in building and applying these models …

Capture, learning, and synthesis of 3D speaking styles

D Cudeiro, T Bolkart, C Laidlaw… - Proceedings of the …, 2019 - openaccess.thecvf.com
Audio-driven 3D facial animation has been widely explored, but achieving realistic, human-
like performance is still unsolved. This is due to the lack of available 3D datasets, models …

Continuous landmark detection with 3d queries

P Chandran, G Zoss, P Gotardo… - Proceedings of the …, 2023 - openaccess.thecvf.com
Neural networks for facial landmark detection are notoriously limited to a fixed set of
landmarks in a dedicated layout, which must be specified at training time. Dedicated …

High-fidelity facial reflectance and geometry inference from an unconstrained image

S Yamaguchi, S Saito, K Nagano, Y Zhao… - ACM Transactions on …, 2018 - dl.acm.org
We present a deep learning-based technique to infer high-quality facial reflectance and
geometry given a single unconstrained image of the subject, which may contain partial …