Interdiff: Generating 3d human-object interactions with physics-informed diffusion

S Xu, Z Li, YX Wang, LY Gui - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
This paper addresses a novel task of anticipating 3D human-object interactions (HOIs). Most
existing research on HOI synthesis lacks comprehensive whole-body interactions with …

Unidexgrasp: Universal robotic dexterous grasping via learning diverse proposal generation and goal-conditioned policy

Y Xu, W Wan, J Zhang, H Liu, Z Shan… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this work, we tackle the problem of learning universal robotic dexterous grasping from a
point cloud observation under a table-top setting. The goal is to grasp and lift up objects in …

Behave: Dataset and method for tracking human object interactions

BL Bhatnagar, X Xie, IA Petrov… - Proceedings of the …, 2022 - openaccess.thecvf.com
Modelling interactions between humans and objects in natural environments is central to
many applications including gaming, virtual and mixed reality, as well as human behavior …

Affordance diffusion: Synthesizing hand-object interactions

Y Ye, X Li, A Gupta, S De Mello… - Proceedings of the …, 2023 - openaccess.thecvf.com
Recent successes in image synthesis are powered by large-scale diffusion models.
However, most methods are currently limited to either text-or image-conditioned generation …

DexYCB: A benchmark for capturing hand grasping of objects

YW Chao, W Yang, Y Xiang… - Proceedings of the …, 2021 - openaccess.thecvf.com
We introduce DexYCB, a new dataset for capturing hand grasping of objects. We first
compare DexYCB with a related one through cross-dataset evaluation. We then present a …

ARCTIC: A dataset for dexterous bimanual hand-object manipulation

Z Fan, O Taheri, D Tzionas… - Proceedings of the …, 2023 - openaccess.thecvf.com
Humans intuitively understand that inanimate objects do not move by themselves, but that
state changes are typically caused by human manipulation (eg, the opening of a book). This …

Smplicit: Topology-aware generative model for clothed people

E Corona, A Pumarola, G Alenya… - Proceedings of the …, 2021 - openaccess.thecvf.com
In this paper we introduce SMPLicit, a novel generative model to jointly represent body
pose, shape and clothing geometry. In contrast to existing learning-based approaches that …

GOAL: Generating 4D whole-body motion for hand-object grasping

O Taheri, V Choutas, MJ Black… - Proceedings of the …, 2022 - openaccess.thecvf.com
Generating digital humans that move realistically has many applications and is widely
studied, but existing methods focus on the major limbs of the body, ignoring the hands and …

Diffusion-guided reconstruction of everyday hand-object interaction clips

Y Ye, P Hebbar, A Gupta… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
We tackle the task of reconstructing hand-object interactions from short video clips. Given an
input video, our approach casts 3D inference as a per-video optimization and recovers a …

Review of learning-based robotic manipulation in cluttered environments

MQ Mohammed, LC Kwek, SC Chua, A Al-Dhaqm… - Sensors, 2022 - mdpi.com
Robotic manipulation refers to how robots intelligently interact with the objects in their
surroundings, such as grasping and carrying an object from one place to another. Dexterous …