A Comprehensive Review of Data‐Driven Co‐Speech Gesture Generation

S Nyatsanga, T Kucherenko, C Ahuja… - Computer Graphics …, 2023 - Wiley Online Library
Gestures that accompany speech are an essential part of natural and efficient embodied
human communication. The automatic generation of such co‐speech gestures is a long …

ZeroEGGS: Zero‐shot Example‐based Gesture Generation from Speech

S Ghorbani, Y Ferstl, D Holden, NF Troje… - Computer Graphics …, 2023 - Wiley Online Library
We present ZeroEGGS, a neural network framework for speech‐driven gesture generation
with zero‐shot style control by example. This means style can be controlled via only a short …

The GENEA Challenge 2022: A large evaluation of data-driven co-speech gesture generation

Y Yoon, P Wolfert, T Kucherenko, C Viegas… - Proceedings of the …, 2022 - dl.acm.org
This paper reports on the second GENEA Challenge to benchmark data-driven automatic co-
speech gesture generation. Participating teams used the same speech and motion dataset …

The GENEA Challenge 2023: A large-scale evaluation of gesture generation models in monadic and dyadic settings

T Kucherenko, R Nagy, Y Yoon, J Woo… - Proceedings of the 25th …, 2023 - dl.acm.org
This paper reports on the GENEA Challenge 2023, in which participating teams built speech-
driven gesture-generation systems using the same speech and motion dataset, followed by …

A large, crowdsourced evaluation of gesture generation systems on common data: The GENEA Challenge 2020

T Kucherenko, P Jonell, Y Yoon, P Wolfert… - Proceedings of the 26th …, 2021 - dl.acm.org
Co-speech gestures, gestures that accompany speech, play an important role in human
communication. Automatic co-speech gesture generation is thus a key enabling technology …

Diffusion-based co-speech gesture generation using joint text and audio representation

A Deichler, S Mehta, S Alexanderson… - Proceedings of the 25th …, 2023 - dl.acm.org
This paper describes a system developed for the GENEA (Generation and Evaluation of Non-
verbal Behaviour for Embodied Agents) Challenge 2023. Our solution builds on an existing …

Co-speech gesture synthesis using discrete gesture token learning

S Lu, Y Yoon, A Feng - 2023 IEEE/RSJ International …, 2023 - ieeexplore.ieee.org
Synthesizing realistic co-speech gestures is an important and yet unsolved problem for
creating believable motions that can drive a humanoid robot to interact and communicate …

Sgtoolkit: An interactive gesture authoring toolkit for embodied conversational agents

Y Yoon, K Park, M Jang, J Kim, G Lee - The 34th annual ACM …, 2021 - dl.acm.org
Non-verbal behavior is essential for embodied agents like social robots, virtual avatars, and
digital humans. Existing behavior authoring approaches including keyframe animation and …

Integrated speech and gesture synthesis

S Wang, S Alexanderson, J Gustafson… - Proceedings of the …, 2021 - dl.acm.org
Text-to-speech and co-speech gesture synthesis have until now been treated as separate
areas by two different research communities, and applications merely stack the two …

The ReprGesture entry to the GENEA Challenge 2022

S Yang, Z Wu, M Li, M Zhao, J Lin, L Chen… - Proceedings of the 2022 …, 2022 - dl.acm.org
This paper describes the ReprGesture entry to the Generation and Evaluation of Non-verbal
Behaviour for Embodied Agents (GENEA) challenge 2022. The GENEA challenge provides …