Makeup Prior Models for 3D Facial Makeup Estimation and Applications

X Yang, T Taketomi, Y Endo… - Proceedings of the …, 2024 - openaccess.thecvf.com
In this work we introduce two types of makeup prior models to extend existing 3D face prior
models: PCA-based and StyleGAN2-based priors. The PCA-based prior model is a linear …

3D Facial Expressions through Analysis-by-Neural-Synthesis

G Retsinas, PP Filntisis, R Danecek… - Proceedings of the …, 2024 - openaccess.thecvf.com
While existing methods for 3D face reconstruction from in-the-wild images excel at
recovering the overall face shape they commonly miss subtle extreme asymmetric or rarely …

Look Ma, no markers: holistic performance capture without the hassle

C Hewitt, F Saleh, S Aliakbarian, L Petikam… - arXiv preprint arXiv …, 2024 - arxiv.org
We tackle the problem of highly-accurate, holistic performance capture for the face, body
and hands simultaneously. Motion-capture technologies used in film and game production …

DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Image

Q Wu, Z Dou, S Xu, S Shimada, C Wang, Z Yu… - arXiv preprint arXiv …, 2024 - arxiv.org
Reconstructing 3D hand-face interactions with deformations from a single image is a
challenging yet crucial task with broad applications in AR, VR, and gaming. The challenges …

Face swapping with adaptive exploration-fusion mechanism and dual en-decoding tactic

G Lan, S Xiao, J Yang, J Wen, W Lu, X Gao - Expert Systems with …, 2024 - Elsevier
Face swapping represents a formidable challenge—it involves a technique that can
seamlessly transplant the identity traits from a source figure into the target figure while …

Infinite 3D Landmarks: Improving Continuous 2D Facial Landmark Detection

P Chandran, G Zoss, P Gotardo… - Computer Graphics …, 2024 - Wiley Online Library
In this paper, we examine three important issues in the practical use of state‐of‐the‐art facial
landmark detectors and show how a combination of specific architectural modifications can …

Refined dense face alignment through image matching

C Li, F Da - The Visual Computer, 2024 - Springer
Face alignment is the foundation of building 3D avatars for virtue communication in the
metaverse, human-computer interaction, AI-generated content, etc., and therefore, it is …

OFER: Occluded Face Expression Reconstruction

P Selvaraju, VF Abrevaya, T Bolkart… - arXiv preprint arXiv …, 2024 - arxiv.org
Reconstructing 3D face models from a single image is an inherently ill-posed problem,
which becomes even more challenging in the presence of occlusions. In addition to fewer …

Semi-Supervised Unconstrained Head Pose Estimation in the Wild

H Zhou, F Jiang, J Yuan, Y Rui, H Lu, K Jia - arXiv preprint arXiv …, 2024 - arxiv.org
Existing research on unconstrained in-the-wild head pose estimation suffers from the flaws
of its datasets, which consist of either numerous samples by non-realistic synthesis or …

Learning a Generalized Physical Face Model From Data

L Yang, G Zoss, P Chandran, M Gross… - arXiv preprint arXiv …, 2024 - arxiv.org
Physically-based simulation is a powerful approach for 3D facial animation as the resulting
deformations are governed by physical constraints, allowing to easily resolve self-collisions …