Interdiff: Generating 3d human-object interactions with physics-informed diffusion

S Xu, Z Li, YX Wang, LY Gui - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
This paper addresses a novel task of anticipating 3D human-object interactions (HOIs). Most
existing research on HOI synthesis lacks comprehensive whole-body interactions with …

Controllable human-object interaction synthesis

J Li, A Clegg, R Mottaghi, J Wu, X Puig… - European Conference on …, 2025 - Springer
Synthesizing semantic-aware, long-horizon, human-object interaction is critical to simulate
realistic human behaviors. In this work, we address the challenging problem of generating …

Cg-hoi: Contact-guided 3d human-object interaction generation

C Diller, A Dai - Proceedings of the IEEE/CVF Conference …, 2024 - openaccess.thecvf.com
We propose CG-HOI the first method to address the task of generating dynamic 3D human-
object interactions (HOIs) from text. We model the motion of both human and object in an …

ArtiGrasp: Physically plausible synthesis of bi-manual dexterous grasping and articulation

H Zhang, S Christen, Z Fan, L Zheng… - … Conference on 3D …, 2024 - ieeexplore.ieee.org
We present ArtiGrasp, a novel method to synthesize bimanual hand-object interactions that
include grasping and articulation. This task is challenging due to the diversity of the global …

Physically plausible full-body hand-object interaction synthesis

J Braun, S Christen, M Kocabas… - … Conference on 3D …, 2024 - ieeexplore.ieee.org
We propose a physics-based method for synthesizing dexterous hand-object interactions in
a full-body setting. While recent advancements have addressed specific facets of human …

Diffh2o: Diffusion-based synthesis of hand-object interactions from textual descriptions

S Christen, S Hampali, F Sener, E Remelli… - SIGGRAPH Asia 2024 …, 2024 - dl.acm.org
We introduce DiffH2O, a new diffusion-based framework for synthesizing realistic, dexterous
hand-object interactions from natural language. Our model employs a temporal two-stage …

Grasping diverse objects with simulated humanoids

Z Luo, J Cao, S Christen, A Winkler, K Kitani… - arXiv preprint arXiv …, 2024 - arxiv.org
We present a method for controlling a simulated humanoid to grasp an object and move it to
follow an object trajectory. Due to the challenges in controlling a humanoid with dexterous …

BOTH2Hands: Inferring 3D Hands from Both Text Prompts and Body Dynamics

W Zhang, M Huang, Y Zhou, J Zhang… - Proceedings of the …, 2024 - openaccess.thecvf.com
The recently emerging text-to-motion advances have spired numerous attempts for
convenient and interactive human motion generation. Yet existing methods are largely …

Vocapter: Voting-based pose tracking for category-level articulated object via inter-frame priors

L Zhang, Z Han, Y Zhong, Q Yu, X Wu, X Wang… - Proceedings of the …, 2024 - dl.acm.org
Articulated objects are common in our daily life. However, current category-level articulation
pose works mostly focus on predicting 9D poses on statistical point cloud observations. In …

Duolando: Follower gpt with off-policy reinforcement learning for dance accompaniment

L Siyao, T Gu, Z Yang, Z Lin, Z Liu, H Ding… - arXiv preprint arXiv …, 2024 - arxiv.org
We introduce a novel task within the field of 3D dance generation, termed dance
accompaniment, which necessitates the generation of responsive movements from a dance …