State of the art on monocular 3D face reconstruction, tracking, and applications

M Zollhöfer, J Thies, P Garrido, D Bradley… - Computer graphics …, 2018 - Wiley Online Library
The computer graphics and vision communities have dedicated long standing efforts in
building computerized tools for reconstructing, tracking, and analyzing human faces based …

Multi-view stereo: A tutorial

Y Furukawa, C Hernández - Foundations and Trends® in …, 2015 - nowpublishers.com
This tutorial presents a hands-on view of the field of multi-view stereo with a focus on
practical algorithms. Multi-view stereo algorithms are able to construct highly detailed 3D …

Dynamic neural radiance fields for monocular 4d facial avatar reconstruction

G Gafni, J Thies, M Zollhofer… - Proceedings of the …, 2021 - openaccess.thecvf.com
We present dynamic neural radiance fields for modeling the appearance and dynamics of a
human face. Digitally modeling and reconstructing a talking human is a key building-block …

Relightable gaussian codec avatars

S Saito, G Schwartz, T Simon, J Li… - Proceedings of the …, 2024 - openaccess.thecvf.com
The fidelity of relighting is bounded by both geometry and appearance representations. For
geometry both mesh and volumetric approaches have difficulty modeling intricate structures …

Authentic volumetric avatars from a phone scan

C Cao, T Simon, JK Kim, G Schwartz… - ACM Transactions on …, 2022 - dl.acm.org
Creating photorealistic avatars of existing people currently requires extensive person-
specific data capture, which is usually only accessible to the VFX industry and not the …

Neural volumes: Learning dynamic renderable volumes from images

S Lombardi, T Simon, J Saragih, G Schwartz… - arXiv preprint arXiv …, 2019 - arxiv.org
Modeling and rendering of dynamic scenes is challenging, as natural scenes often contain
complex phenomena such as thin structures, evolving topology, translucency, scattering …

3d face reconstruction with dense landmarks

E Wood, T Baltrušaitis, C Hewitt, M Johnson… - … on Computer Vision, 2022 - Springer
Landmarks often play a key role in face analysis, but many aspects of identity or expression
cannot be represented by sparse landmarks alone. Thus, in order to reconstruct faces more …

[PDF][PDF] Learning a model of facial shape and expression from 4D scans.

T Li, T Bolkart, MJ Black, H Li, J Romero - ACM Trans. Graph., 2017 - 3dvar.com
Learning a model of facial shape and expression from 4D scans Page 1 Learning a model
of facial shape and expression from 4D scans TIANYE LI∗†, University of Southern …

Total capture: A 3d deformation model for tracking faces, hands, and bodies

H Joo, T Simon, Y Sheikh - Proceedings of the IEEE …, 2018 - openaccess.thecvf.com
We present a unified deformation model for the markerless capture of multiple scales of
human movement, including facial expressions, body motion, and hand gestures. An initial …

The relightables: Volumetric performance capture of humans with realistic relighting

K Guo, P Lincoln, P Davidson, J Busch, X Yu… - ACM Transactions on …, 2019 - dl.acm.org
We present" The Relightables", a volumetric capture system for photorealistic and high
quality relightable full-body performance capture. While significant progress has been made …