Nifty: Neural object interaction fields for guided human motion synthesis

N Kulkarni, D Rempe, K Genova… - Proceedings of the …, 2024 - openaccess.thecvf.com
We address the problem of generating realistic 3D motions of humans interacting with
objects in a scene. Our key idea is to create a neural interaction field attached to a specific …

MIME: Human-aware 3D scene generation

H Yi, CHP Huang, S Tripathi, L Hering… - Proceedings of the …, 2023 - openaccess.thecvf.com
Generating realistic 3D worlds occupied by moving humans has many applications in
games, architecture, and synthetic data creation. But generating such scenes is expensive …

Diffusion-guided reconstruction of everyday hand-object interaction clips

Y Ye, P Hebbar, A Gupta… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
We tackle the task of reconstructing hand-object interactions from short video clips. Given an
input video, our approach casts 3D inference as a per-video optimization and recovers a …

Generating human interaction motions in scenes with text control

H Yi, J Thies, MJ Black, XB Peng, D Rempe - European Conference on …, 2025 - Springer
We present TeSMo, a text-controlled scene-aware motion generation method based on
denoising diffusion models. Previous text-to-motion methods focus on characters in isolation …

LEMON: Learning 3D Human-Object Interaction Relation from 2D Images

Y Yang, W Zhai, H Luo, Y Cao… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Learning 3D human-object interaction relation is pivotal to embodied AI and interaction
modeling. Most existing methods approach the goal by learning to predict isolated …

Roam: Robust and object-aware motion generation using neural pose descriptors

W Zhang, R Dabral, T Leimkühler… - … Conference on 3D …, 2024 - ieeexplore.ieee.org
Existing automatic approaches for 3D virtual character motion synthesis supporting scene
interactions do not gen-eralise well to new objects outside training distributions, even when …

Language-driven scene synthesis using multi-conditional diffusion model

AD Vuong, MN Vu, T Nguyen… - Advances in …, 2024 - proceedings.neurips.cc
Scene synthesis is a challenging problem with several industrial applications. Recently,
substantial efforts have been directed to synthesize the scene using human motions, room …

Generating activity snippets by learning human-scene interactions

C Li, LF Yu - ACM Transactions on Graphics (TOG), 2023 - dl.acm.org
We present an approach to generate virtual activity snippets, which comprise sequenced
keyframes of multi-character, multi-object interaction scenarios in 3D environments, by …

Revisit human-scene interaction via space occupancy

X Liu, H Hou, Y Yang, YL Li, C Lu - European Conference on Computer …, 2025 - Springer
Human-scene Interaction (HSI) generation is a challenging task and crucial for various
downstream tasks. However, one of the major obstacles is its limited data scale. High-quality …

Haisor: Human-aware Indoor Scene Optimization via Deep Reinforcement Learning

JM Sun, J Yang, K Mo, YK Lai, L Guibas… - ACM Transactions on …, 2024 - dl.acm.org
3D scene synthesis facilitates and benefits many real-world applications. Most scene
generators focus on making indoor scenes plausible via learning from training data and …