Application of a 3D Talking Head as Part of Telecommunication AR, VR, MR System: Systematic Review

N Christoff, NN Neshov, K Tonchev, A Manolova - Electronics, 2023 - mdpi.com
In today's digital era, the realms of virtual reality (VR), augmented reality (AR), and mixed
reality (MR) collectively referred to as extended reality (XR) are reshaping human–computer …

A dance movement quality evaluation model using transformer encoder and convolutional neural network

J Qu - Scientific Reports, 2024 - nature.com
The purpose of this study is to put forward a new evaluation model of dance movement
quality to deal with the subjectivity and inconsistency in traditional evaluation methods. In …

Audio-Driven 3D Talking Face for Realistic Holographic Mixed-Reality Telepresence

N Christoff, K Tonchev, N Neshov… - … Sea Conference on …, 2023 - ieeexplore.ieee.org
Machines' ability to effectively understand human speech based on visual input is crucial for
efficient communication. However, distinguishing between the semantics of speech and the …

Video-driven speaker-listener generation based on Transformer and neural renderer

D Yang, Q Yang, W Jiang, J Chen, Z Shao… - Multimedia Tools and …, 2024 - Springer
The traditional speaker-centric synthesis methods prioritize language accuracy but overlook
emotional connection and feedback mechanisms with the audience. This paper is dedicated …

Implicit Memory-Based Variational Motion Talking Face Generation

D Yang, S Huang, W Jiang, J Zou - IEEE Signal Processing …, 2024 - ieeexplore.ieee.org
Speech-driven facial animation is a challenging problem where each input audio can have
multiple plausible facial outputs, leading to overly smooth results. Although the two-stage …

Talking Portrait with Discrete Motion Priors in Neural Radiation Field

D Yang, Y Liu, Q Yang, R Li - 2024 IEEE International …, 2024 - ieeexplore.ieee.org
Speech-driven facial video is a one-to-many mapping problem where each input audio can
have multiple plausible facial outputs, leading to overly smooth facial movements results. To …