Human motion generation: A survey

W Zhu, X Ma, D Ro, H Ci, J Zhang, J Shi… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
Human motion generation aims to generate natural human pose sequences and shows
immense potential for real-world applications. Substantial progress has been made recently …

Motiongpt: Human motion as a foreign language

B Jiang, X Chen, W Liu, J Yu, G Yu… - Advances in Neural …, 2024 - proceedings.neurips.cc
Though the advancement of pre-trained large language models unfolds, the exploration of
building a unified model for language and other multimodal data, such as motion, remains …

Physdiff: Physics-guided human motion diffusion model

Y Yuan, J Song, U Iqbal, A Vahdat… - Proceedings of the …, 2023 - openaccess.thecvf.com
Denoising diffusion models hold great promise for generating diverse and realistic human
motions. However, existing motion diffusion models largely disregard the laws of physics in …

TEMOS: Generating Diverse Human Motions from Textual Descriptions

M Petrovich, MJ Black, G Varol - European Conference on Computer …, 2022 - Springer
We address the problem of generating diverse 3D human motions from textual descriptions.
This challenging task requires joint modeling of both modalities: understanding and …

Diffusion-based generation, optimization, and planning in 3d scenes

S Huang, Z Wang, P Li, B Jia, T Liu… - Proceedings of the …, 2023 - openaccess.thecvf.com
We introduce SceneDiffuser, a conditional generative model for 3D scene understanding.
SceneDiffuser provides a unified model for solving scene-conditioned generation …

Interdiff: Generating 3d human-object interactions with physics-informed diffusion

S Xu, Z Li, YX Wang, LY Gui - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
This paper addresses a novel task of anticipating 3D human-object interactions (HOIs). Most
existing research on HOI synthesis lacks comprehensive whole-body interactions with …

Tm2t: Stochastic and tokenized modeling for the reciprocal generation of 3d human motions and texts

C Guo, X Zuo, S Wang, L Cheng - European Conference on Computer …, 2022 - Springer
Inspired by the strong ties between vision and language, the two intimate human sensing
and communication modalities, our paper aims to explore the generation of 3D human full …

Action-conditioned 3d human motion synthesis with transformer vae

M Petrovich, MJ Black, G Varol - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
We tackle the problem of action-conditioned generation of realistic and diverse human
motion sequences. In contrast to methods that complete, or extend, motion sequences, this …

Agentformer: Agent-aware transformers for socio-temporal multi-agent forecasting

Y Yuan, X Weng, Y Ou… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Predicting accurate future trajectories of multiple agents is essential for autonomous systems
but is challenging due to the complex interaction between agents and the uncertainty in …

Humor: 3d human motion model for robust pose estimation

D Rempe, T Birdal, A Hertzmann… - Proceedings of the …, 2021 - openaccess.thecvf.com
We introduce HuMoR: a 3D Human Motion Model for Robust Estimation of temporal pose
and shape. Though substantial progress has been made in estimating 3D human motion …