A Comprehensive Review of Data‐Driven Co‐Speech Gesture Generation

S Nyatsanga, T Kucherenko, C Ahuja… - Computer Graphics …, 2023 - Wiley Online Library
Gestures that accompany speech are an essential part of natural and efficient embodied
human communication. The automatic generation of such co‐speech gestures is a long …

A review of evaluation practices of gesture generation in embodied conversational agents

P Wolfert, N Robinson… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Embodied conversational agents (ECAs) are often designed to produce nonverbal behavior
to complement or enhance their verbal communication. One such form of the nonverbal …

The GENEA Challenge 2022: A large evaluation of data-driven co-speech gesture generation

Y Yoon, P Wolfert, T Kucherenko, C Viegas… - Proceedings of the …, 2022 - dl.acm.org
This paper reports on the second GENEA Challenge to benchmark data-driven automatic co-
speech gesture generation. Participating teams used the same speech and motion dataset …

The GENEA Challenge 2023: A large-scale evaluation of gesture generation models in monadic and dyadic settings

T Kucherenko, R Nagy, Y Yoon, J Woo… - Proceedings of the 25th …, 2023 - dl.acm.org
This paper reports on the GENEA Challenge 2023, in which participating teams built speech-
driven gesture-generation systems using the same speech and motion dataset, followed by …

Didn't see that coming: a survey on non-verbal social human behavior forecasting

G Barquero, J Núnez, S Escalera, Z Xu… - … Social Behavior in …, 2022 - proceedings.mlr.press
Non-verbal social human behavior forecasting has increasingly attracted the interest of the
research community in recent years. Its direct applications to human-robot interaction and …

Towards AI-Mediated Avatar-Based Telecommunication: Investigating Visual Impression of Switching Between User-and AI-Controlled Avatars in Video Chat

S Yoshida, Y Koyama, Y Ushiku - IEEE Access, 2024 - ieeexplore.ieee.org
Telecommunications technology has evolved rapidly, creating opportunities to diversify the
communication culture through AI mediation. We anticipate that people will interchangeably …

Evaluating gesture generation in a large-scale open challenge: The GENEA Challenge 2022

T Kucherenko*, P Wolfert*, Y Yoon*, C Viegas… - ACM Transactions on …, 2024 - dl.acm.org
This article reports on the second GENEA Challenge to benchmark data-driven automatic co-
speech gesture generation. Participating teams used the same speech and motion dataset …

Large language models in textual analysis for gesture selection

LB Hensel, N Yongsatianchot, P Torshizi… - Proceedings of the 25th …, 2023 - dl.acm.org
Gestures perform a variety of communicative functions that powerfully influence human face-
to-face interaction. How this communicative function is achieved varies greatly between …

Towards the generation of synchronized and believable non-verbal facial behaviors of a talking virtual agent

A Delbosc, M Ochs, N Sabouret, B Ravenet… - … Publication of the 25th …, 2023 - dl.acm.org
This paper introduces a new model to generate rhythmically relevant non-verbal facial
behaviors for virtual agents while they speak. The model demonstrates perceived …

Data-Driven Communicative Behaviour Generation: A Survey

N Oralbayeva, A Aly, A Sandygulova… - ACM Transactions on …, 2024 - dl.acm.org
The development of data-driven behaviour generating systems has recently become the
focus of considerable attention in the fields of human–agent interaction and human–robot …