State of the art on monocular 3D face reconstruction, tracking, and applications

M Zollhöfer, J Thies, P Garrido, D Bradley… - Computer graphics …, 2018 - Wiley Online Library
The computer graphics and vision communities have dedicated long standing efforts in
building computerized tools for reconstructing, tracking, and analyzing human faces based …

A review of eye gaze in virtual agents, social robotics and hci: Behaviour generation, user interaction and perception

K Ruhland, CE Peters, S Andrist… - Computer graphics …, 2015 - Wiley Online Library
A person's emotions and state of mind are apparent in their face and eyes. As a Latin
proverb states:'The face is the portrait of the mind; the eyes, its informers'. This presents a …

3d morphable face models—past, present, and future

B Egger, WAP Smith, A Tewari, S Wuhrer… - ACM Transactions on …, 2020 - dl.acm.org
In this article, we provide a detailed survey of 3D Morphable Face Models over the 20 years
since they were first proposed. The challenges in building and applying these models …

Learning an appearance-based gaze estimator from one million synthesised images

E Wood, T Baltrušaitis, LP Morency… - Proceedings of the …, 2016 - dl.acm.org
Learning-based methods for appearance-based gaze estimation achieve state-of-the-art
performance in challenging real-world settings but require large amounts of labelled training …

Rendering of eyes for eye-shape registration and gaze estimation

E Wood, T Baltrusaitis, X Zhang… - Proceedings of the …, 2015 - openaccess.thecvf.com
Images of the eye are key in several computer vision problems, such as shape registration
and gaze estimation. Recent large-scale supervised methods for these problems require …

Reconstruction of personalized 3D face rigs from monocular video

P Garrido, M Zollhöfer, D Casas, L Valgaerts… - ACM Transactions on …, 2016 - dl.acm.org
We present a novel approach for the automatic creation of a personalized high-quality 3D
face rig of an actor from just monocular video data (eg, vintage movies). Our rig is based on …

Dynamic 3D avatar creation from hand-held video input

AE Ichim, S Bouaziz, M Pauly - ACM Transactions on Graphics (ToG), 2015 - dl.acm.org
We present a complete pipeline for creating fully rigged, personalized 3D facial avatars from
hand-held video. Our system faithfully recovers facial expression dynamics of the user by …

Neural rendering and reenactment of human actor videos

L Liu, W Xu, M Zollhoefer, H Kim, F Bernard… - ACM Transactions on …, 2019 - dl.acm.org
We propose a method for generating video-realistic animations of real humans under user
control. In contrast to conventional human character rendering, we do not require the …

Preface: A data-driven volumetric prior for few-shot ultra high-resolution face synthesis

MC Bühler, K Sarkar, T Shah, G Li… - Proceedings of the …, 2023 - openaccess.thecvf.com
NeRFs have enabled highly realistic synthesis of human faces including complex
appearance and reflectance effects of hair and skin. These methods typically require a large …

Towards a complete 3D morphable model of the human head

S Ploumpis, E Ververas, E O'Sullivan… - IEEE transactions on …, 2020 - ieeexplore.ieee.org
Three-dimensional morphable models (3DMMs) are powerful statistical tools for
representing the 3D shapes and textures of an object class. Here we present the most …