A Comprehensive Review of Data‐Driven Co‐Speech Gesture Generation

S Nyatsanga, T Kucherenko, C Ahuja… - Computer Graphics …, 2023 - Wiley Online Library
Gestures that accompany speech are an essential part of natural and efficient embodied
human communication. The automatic generation of such co‐speech gestures is a long …

Rhythmic gesticulator: Rhythm-aware co-speech gesture synthesis with hierarchical neural embeddings

T Ao, Q Gao, Y Lou, B Chen, L Liu - ACM Transactions on Graphics …, 2022 - dl.acm.org
Automatic synthesis of realistic co-speech gestures is an increasingly important yet
challenging task in artificial embodied agent creation. Previous systems mainly focus on …

The GENEA Challenge 2022: A large evaluation of data-driven co-speech gesture generation

Y Yoon, P Wolfert, T Kucherenko, C Viegas… - Proceedings of the …, 2022 - dl.acm.org
This paper reports on the second GENEA Challenge to benchmark data-driven automatic co-
speech gesture generation. Participating teams used the same speech and motion dataset …

Seeg: Semantic energized co-speech gesture generation

Y Liang, Q Feng, L Zhu, L Hu… - Proceedings of the …, 2022 - openaccess.thecvf.com
Talking gesture generation is a practical yet challenging task which aims to synthesize
gestures in line with speech. Gestures with meaningful signs can better convey useful …

Speech-based gesture generation for robots and embodied agents: A scoping review

Y Liu, G Mohammadi, Y Song, W Johal - Proceedings of the 9th …, 2021 - dl.acm.org
Humans use gestures as a means of non-verbal communication. Often accompanying
speech, these gestures have several purposes but in general, aim to convey an intended …

Emotiongesture: Audio-driven diverse emotional co-speech 3d gesture generation

X Qi, C Liu, L Li, J Hou, H Xin… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Generating vivid and diverse 3D co-speech gestures is crucial for various applications in
animating virtual avatars. While most existing methods can generate gestures from audio …

A large, crowdsourced evaluation of gesture generation systems on common data: The GENEA Challenge 2020

T Kucherenko, P Jonell, Y Yoon, P Wolfert… - Proceedings of the 26th …, 2021 - dl.acm.org
Co-speech gestures, gestures that accompany speech, play an important role in human
communication. Automatic co-speech gesture generation is thus a key enabling technology …

What affects the usage of artificial conversational agents? An agent personality and love theory perspective

D Pal, V Vanijja, H Thapliyal, X Zhang - Computers in Human Behavior, 2023 - Elsevier
Artificial-intelligence (AI) powered conversational (CAI) agents have been growing in
popularity. Like human personality, CAI agent personality can also impact the relationship …

Diverse 3d hand gesture prediction from body dynamics by bilateral hand disentanglement

X Qi, C Liu, M Sun, L Li, C Fan… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Predicting natural and diverse 3D hand gestures from the upper body dynamics is a
practical yet challenging task in virtual avatar creation. Previous works usually overlook the …

Low-resource adaptation for personalized co-speech gesture generation

C Ahuja, DW Lee, LP Morency - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Personalizing an avatar for co-speech gesture generation from spoken language requires
learning the idiosyncrasies of a person's gesture style from a small amount of data. Previous …