Gesturediffuclip: Gesture diffusion model with clip latents

T Ao, Z Zhang, L Liu - ACM Transactions on Graphics (TOG), 2023 - dl.acm.org
The automatic generation of stylized co-speech gestures has recently received increasing
attention. Previous systems typically allow style control via predefined text labels or example …

Rhythmic gesticulator: Rhythm-aware co-speech gesture synthesis with hierarchical neural embeddings

T Ao, Q Gao, Y Lou, B Chen, L Liu - ACM Transactions on Graphics …, 2022 - dl.acm.org
Automatic synthesis of realistic co-speech gestures is an increasingly important yet
challenging task in artificial embodied agent creation. Previous systems mainly focus on …

The GENEA Challenge 2022: A large evaluation of data-driven co-speech gesture generation

Y Yoon, P Wolfert, T Kucherenko, C Viegas… - Proceedings of the …, 2022 - dl.acm.org
This paper reports on the second GENEA Challenge to benchmark data-driven automatic co-
speech gesture generation. Participating teams used the same speech and motion dataset …

Vision+ language applications: A survey

Y Zhou, N Shimada - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Text-to-image generation has attracted significant interest from researchers and practitioners
in recent years due to its widespread and diverse applications across various industries …

Gesture2Vec: Clustering gestures using representation learning methods for co-speech gesture generation

PJ Yazdian, M Chen, A Lim - 2022 IEEE/RSJ International …, 2022 - ieeexplore.ieee.org
Co-speech gestures are a principal component in conveying messages and enhancing
interaction experiences between humans and critical ingredients in human-agent …

Extrovert or Introvert? GAN-Based Humanoid Upper-Body Gesture Generation for Different Impressions

B Wu, C Liu, CT Ishi, J Shi, H Ishiguro - International Journal of Social …, 2023 - Springer
Gestures, a form of body language, significantly influence how users perceive humanoid
robots. Recent data-driven methods for co-speech gestures have successfully enhanced the …

Multimodal analysis of the predictability of hand-gesture properties

T Kucherenko, R Nagy, M Neff, H Kjellström… - arXiv preprint arXiv …, 2021 - arxiv.org
Embodied conversational agents benefit from being able to accompany their speech with
gestures. Although many data-driven approaches to gesture generation have been …

ConvoFusion: Multi-Modal Conversational Diffusion for Co-Speech Gesture Synthesis

MH Mughal, R Dabral, I Habibie… - Proceedings of the …, 2024 - openaccess.thecvf.com
Gestures play a key role in human communication. Recent methods for co-speech gesture
generation while managing to generate beat-aligned motions struggle generating gestures …

Augmented Co-Speech Gesture Generation: Including Form and Meaning Features to Guide Learning-Based Gesture Synthesis

H Voß, S Kopp - Proceedings of the 23rd ACM International Conference …, 2023 - dl.acm.org
Due to their significance in human communication, the automatic generation of co-speech
gestures in artificial embodied agents has received a lot of attention. Although modern deep …

Evaluating gesture generation in a large-scale open challenge: The GENEA Challenge 2022

T Kucherenko*, P Wolfert*, Y Yoon*, C Viegas… - ACM Transactions on …, 2024 - dl.acm.org
This article reports on the second GENEA Challenge to benchmark data-driven automatic co-
speech gesture generation. Participating teams used the same speech and motion dataset …