State of the art on monocular 3D face reconstruction, tracking, and applications

M Zollhöfer, J Thies, P Garrido, D Bradley… - Computer graphics …, 2018 - Wiley Online Library
The computer graphics and vision communities have dedicated long standing efforts in
building computerized tools for reconstructing, tracking, and analyzing human faces based …

State of the art on 3D reconstruction with RGB‐D cameras

M Zollhöfer, P Stotko, A Görlitz… - Computer graphics …, 2018 - Wiley Online Library
The advent of affordable consumer grade RGB‐D cameras has brought about a profound
advancement of visual scene reconstruction methods. Both computer graphics and …

Nerfies: Deformable neural radiance fields

K Park, U Sinha, JT Barron, S Bouaziz… - Proceedings of the …, 2021 - openaccess.thecvf.com
We present the first method capable of photorealistically reconstructing deformable scenes
using photos/videos captured casually from mobile phones. Our approach augments neural …

Neural head avatars from monocular rgb videos

PW Grassal, M Prinzler, T Leistner… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract We present Neural Head Avatars, a novel neural representation that explicitly
models the surface geometry and appearance of an animatable human avatar that can be …

Dynamic neural radiance fields for monocular 4d facial avatar reconstruction

G Gafni, J Thies, M Zollhofer… - Proceedings of the …, 2021 - openaccess.thecvf.com
We present dynamic neural radiance fields for modeling the appearance and dynamics of a
human face. Digitally modeling and reconstructing a talking human is a key building-block …

Instant volumetric head avatars

W Zielonka, T Bolkart, J Thies - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Abstract We present Instant Volumetric Head Avatars (INSTA), a novel approach for
reconstructing photo-realistic digital avatars instantaneously. INSTA models a dynamic …

Generating 3D faces using convolutional mesh autoencoders

A Ranjan, T Bolkart, S Sanyal… - Proceedings of the …, 2018 - openaccess.thecvf.com
Learned 3D representations of human faces are useful for computer vision problems such
as 3D face tracking and reconstruction from images, as well as graphics applications such …

Facescape: a large-scale high quality 3d face dataset and detailed riggable 3d face prediction

H Yang, H Zhu, Y Wang, M Huang… - Proceedings of the …, 2020 - openaccess.thecvf.com
In this paper, we present a large-scale detailed 3D face dataset, FaceScape, and propose a
novel algorithm that is able to predict elaborate riggable 3D face models from a single image …

[PDF][PDF] Learning a model of facial shape and expression from 4D scans.

T Li, T Bolkart, MJ Black, H Li, J Romero - ACM Trans. Graph., 2017 - 3dvar.com
Learning a model of facial shape and expression from 4D scans Page 1 Learning a model
of facial shape and expression from 4D scans TIANYE LI∗†, University of Southern …

Face2face: Real-time face capture and reenactment of rgb videos

J Thies, M Zollhofer, M Stamminger… - Proceedings of the …, 2016 - openaccess.thecvf.com
We present a novel approach for real-time facial reenactment of a monocular target video
sequence (eg, Youtube video). The source sequence is also a monocular video stream …