Large motion model for unified multi-modal motion generation

M Zhang, D Jin, C Gu, F Hong, Z Cai, J Huang… - … on Computer Vision, 2025 - Springer
Human motion generation, a cornerstone technique in animation and video production, has
widespread applications in various tasks like text-to-motion and music-to-dance. Previous …

The GENEA Challenge 2023: A large-scale evaluation of gesture generation models in monadic and dyadic settings

T Kucherenko, R Nagy, Y Yoon, J Woo… - Proceedings of the 25th …, 2023 - dl.acm.org
This paper reports on the GENEA Challenge 2023, in which participating teams built speech-
driven gesture-generation systems using the same speech and motion dataset, followed by …

Weakly-Supervised Emotion Transition Learning for Diverse 3D Co-speech Gesture Generation

X Qi, J Pan, P Li, R Yuan, X Chi, M Li… - Proceedings of the …, 2024 - openaccess.thecvf.com
Generating vivid and emotional 3D co-speech gestures is crucial for virtual avatar animation
in human-machine interaction applications. While the existing methods enable generating …

ConvoFusion: Multi-Modal Conversational Diffusion for Co-Speech Gesture Synthesis

MH Mughal, R Dabral, I Habibie… - Proceedings of the …, 2024 - openaccess.thecvf.com
Gestures play a key role in human communication. Recent methods for co-speech gesture
generation while managing to generate beat-aligned motions struggle generating gestures …

Towards realtime co-speech gestures synthesis using STARGATE

L Abel, V Colotte, S Ouni - 25th Interspeech Conference …, 2024 - hal.science
The field of co-speech gestures synthesis is gaining more and more interest. However, many
new systems utilize complex or resource-intensive architectures, making them impractical for …

Retrieving Semantics from the Deep: an RAG Solution for Gesture Synthesis

MH Mughal, R Dabral, MCJ Scholman… - arXiv preprint arXiv …, 2024 - arxiv.org
Non-verbal communication often comprises of semantically rich gestures that help convey
the meaning of an utterance. Producing such semantic co-speech gestures has been a …

2D or not 2D: How Does the Dimensionality of Gesture Representation Affect 3D Co-Speech Gesture Generation?

T Guichoux, L Soulier, N Obin… - Proceedings of the 24th …, 2024 - dl.acm.org
Co-speech gestures are fundamental for communication. The advent of recent deep
learning techniques has facilitated the creation of lifelike, synchronous co-speech gestures …

Gesture Area Coverage to Assess Gesture Expressiveness and Human-Likeness

RL Tonoli, PDP Costa, LBMM Marques… - … Proceedings of the 26th …, 2024 - dl.acm.org
This work introduces the analyses of Gesture Area Coverage (GAC) for evaluating the
expressiveness of co-speech gestures. GAC explicitly considers the spatial coverage of …

Towards interpretable co-speech gestures synthesis using STARGATE

L Abel, V Colotte, S Ouni - … of the 26th International Conference on …, 2024 - dl.acm.org
Co-speech gestures synthesis is a growing field of research. However, new systems often
use complex or heavy architecture, making them unsuitable for incorporation into Embodied …

Investigating the impact of 2D gesture representation on co-speech gesture generation

T Guichoux, L Soulier, N Obin, C Pelachaud - arXiv preprint arXiv …, 2024 - arxiv.org
Co-speech gestures play a crucial role in the interactions between humans and embodied
conversational agents (ECA). Recent deep learning methods enable the generation of …