State of the art on monocular 3D face reconstruction, tracking, and applications

M Zollhöfer, J Thies, P Garrido, D Bradley… - Computer graphics …, 2018 - Wiley Online Library
The computer graphics and vision communities have dedicated long standing efforts in
building computerized tools for reconstructing, tracking, and analyzing human faces based …

Relightable gaussian codec avatars

S Saito, G Schwartz, T Simon, J Li… - Proceedings of the …, 2024 - openaccess.thecvf.com
The fidelity of relighting is bounded by both geometry and appearance representations. For
geometry both mesh and volumetric approaches have difficulty modeling intricate structures …

3d face reconstruction in deep learning era: A survey

S Sharma, V Kumar - Archives of Computational Methods in Engineering, 2022 - Springer
Abstract 3D face reconstruction is the most captivating topic in biometrics with the advent of
deep learning and readily available graphical processing units. This paper explores the …

3d morphable face models—past, present, and future

B Egger, WAP Smith, A Tewari, S Wuhrer… - ACM Transactions on …, 2020 - dl.acm.org
In this article, we provide a detailed survey of 3D Morphable Face Models over the 20 years
since they were first proposed. The challenges in building and applying these models …

Reenactgan: Learning to reenact faces via boundary transfer

W Wu, Y Zhang, C Li, C Qian… - Proceedings of the …, 2018 - openaccess.thecvf.com
We present a novel learning-based framework for face reenactment. The proposed method,
known as ReenactGAN, is capable of transferring facial movements and expressions from …

Fml: Face model learning from videos

A Tewari, F Bernard, P Garrido… - Proceedings of the …, 2019 - openaccess.thecvf.com
Monocular image-based 3D reconstruction of faces is a long-standing problem in computer
vision. Since image data is a 2D projection of a 3D face, the resulting depth ambiguity …

Avatar digitization from a single image for real-time rendering

L Hu, S Saito, L Wei, K Nagano, J Seo… - ACM Transactions on …, 2017 - dl.acm.org
We present a fully automatic framework that digitizes a complete 3D head with hair from a
single unconstrained image. Our system offers a practical and consumer-friendly end-to-end …

Neural rendering and reenactment of human actor videos

L Liu, W Xu, M Zollhoefer, H Kim, F Bernard… - ACM Transactions on …, 2019 - dl.acm.org
We propose a method for generating video-realistic animations of real humans under user
control. In contrast to conventional human character rendering, we do not require the …

Preface: A data-driven volumetric prior for few-shot ultra high-resolution face synthesis

MC Bühler, K Sarkar, T Shah, G Li… - Proceedings of the …, 2023 - openaccess.thecvf.com
NeRFs have enabled highly realistic synthesis of human faces including complex
appearance and reflectance effects of hair and skin. These methods typically require a large …

Deep relightable appearance models for animatable faces

S Bi, S Lombardi, S Saito, T Simon, SE Wei… - ACM Transactions on …, 2021 - dl.acm.org
We present a method for building high-fidelity animatable 3D face models that can be posed
and rendered with novel lighting environments in real-time. Our main insight is that …