Diffposetalk: Speech-driven stylistic 3d facial animation and head pose generation via diffusion models

Z Sun, T Lv, S Ye, M Lin, J Sheng, YH Wen… - ACM Transactions on …, 2024 - dl.acm.org
The generation of stylistic 3D facial animations driven by speech presents a significant
challenge as it requires learning a many-to-many mapping between speech, style, and the …

Emotional speech-driven animation with content-emotion disentanglement

R Daněček, K Chhatre, S Tripathi, Y Wen… - SIGGRAPH Asia 2023 …, 2023 - dl.acm.org
To be widely adopted, 3D facial avatars must be animated easily, realistically, and directly
from speech signals. While the best recent methods generate 3D animations that are …

Facetalk: Audio-driven motion diffusion for neural parametric head models

S Aneja, J Thies, A Dai… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
We introduce FaceTalk a novel generative approach designed for synthesizing high-fidelity
3D motion sequences of talking human heads from input audio signal. To capture the …

Media2face: Co-speech facial animation generation with multi-modality guidance

Q Zhao, P Long, Q Zhang, D Qin, H Liang… - ACM SIGGRAPH 2024 …, 2024 - dl.acm.org
The synthesis of 3D facial animations from speech has garnered considerable attention.
Due to the scarcity of high-quality 4D facial data and well-annotated abundant multi-modality …

[HTML][HTML] A review of motion retargeting techniques for 3D character facial animation

CA Zhu, C Joslin - Computers & Graphics, 2024 - Elsevier
The animation of 3D faces has been a critical component of character animation in a wide
range of media since the early 90's. The conventional process for animating a 3D face is …

[HTML][HTML] Audio-Driven Facial Animation with Deep Learning: A Survey

D Jiang, J Chang, L You, S Bian, R Kosk, G Maguire - Information, 2024 - mdpi.com
Audio-driven facial animation is a rapidly evolving field that aims to generate realistic facial
expressions and lip movements synchronized with a given audio input. This survey provides …

Scantalk: 3d talking heads from unregistered scans

F Nocentini, T Besnier, C Ferrari, S Arguillere… - … on Computer Vision, 2024 - Springer
Speech-driven 3D talking heads generation has emerged as a significant area of interest
among researchers, presenting numerous challenges. Existing methods are constrained by …

Speech4mesh: Speech-assisted monocular 3d facial reconstruction for speech-driven 3d facial animation

S He, H He, S Yang, X Wu, P Xia… - Proceedings of the …, 2023 - openaccess.thecvf.com
Recent audio2mesh-based methods have shown promising prospects for speech-driven 3D
facial animation tasks. However, some intractable challenges are urgent to be settled. For …

Laughtalk: Expressive 3d talking head generation with laughter

K Sung-Bin, L Hyun, DH Hong… - Proceedings of the …, 2024 - openaccess.thecvf.com
Laughter is a unique expression, essential to affirmative social interactions of humans.
Although current 3D talking head generation methods produce convincing verbal …

Animateme: 4d facial expressions via diffusion models

D Gerogiannis, FP Papantoniou, RA Potamias… - … on Computer Vision, 2024 - Springer
The field of photorealistic 3D avatar reconstruction and generation has garnered significant
attention in recent years; however, animating such avatars remains challenging. Recent …