Maniskill: Generalizable manipulation skill benchmark with large-scale demonstrations

T Mu, Z Ling, F Xiang, D Yang, X Li, S Tao… - arXiv preprint arXiv …, 2021 - arxiv.org
Object manipulation from 3D visual inputs poses many challenges on building generalizable
perception and policy models. However, 3D assets in existing benchmarks mostly lack the …

Akb-48: A real-world articulated object knowledge base

L Liu, W Xu, H Fu, S Qian, Q Yu… - Proceedings of the …, 2022 - openaccess.thecvf.com
Human life is populated with articulated objects. A comprehensive understanding of
articulated objects, namely appearance, structure, physics property, and semantics, will …

Dexart: Benchmarking generalizable dexterous manipulation with articulated objects

C Bao, H Xu, Y Qin, X Wang - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
To enable general-purpose robots, we will require the robot to operate daily articulated
objects as humans do. Current robot manipulation has heavily relied on using a parallel …

Articulated object interaction in unknown scenes with whole-body mobile manipulation

M Mittal, D Hoeller, F Farshidian… - 2022 IEEE/RSJ …, 2022 - ieeexplore.ieee.org
A kitchen assistant needs to operate human-scale objects, such as cabinets and ovens, in
unmapped environments with dynamic obstacles. Autonomous interactions in such …

MultiScan: Scalable RGBD scanning for 3D environments with articulated objects

Y Mao, Y Zhang, H Jiang, A Chang… - Advances in neural …, 2022 - proceedings.neurips.cc
We introduce MultiScan, a scalable RGBD dataset construction pipeline leveraging
commodity mobile devices to scan indoor scenes with articulated objects and web-based …

Command-driven articulated object understanding and manipulation

R Chu, Z Liu, X Ye, X Tan, X Qi… - Proceedings of the …, 2023 - openaccess.thecvf.com
We present Cart, a new approach towards articulated-object manipulations by human
commands. Beyond the existing work that focuses on inferring articulation structures, we …

Opd: Single-view 3d openable part detection

H Jiang, Y Mao, M Savva, AX Chang - European Conference on Computer …, 2022 - Springer
We address the task of predicting what parts of an object can open and how they move
when they do so. The input is a single image of an object, and as output we detect what …

Learning agent-aware affordances for closed-loop interaction with articulated objects

G Schiavi, P Wulkop, G Rizzi, L Ott… - … on Robotics and …, 2023 - ieeexplore.ieee.org
Interactions with articulated objects are a challenging but important task for mobile robots.
To tackle this challenge, we propose a novel closed-loop control pipeline, which integrates …

Structure from action: Learning interactions for articulated object 3d structure discovery

N Nie, SY Gadre, K Ehsani, S Song - arXiv preprint arXiv:2207.08997, 2022 - arxiv.org
We introduce Structure from Action (SfA), a framework to discover 3D part geometry and joint
parameters of unseen articulated objects via a sequence of inferred interactions. Our key …

Learning category-level generalizable object manipulation policy via generative adversarial self-imitation learning from demonstrations

H Shen, W Wan, H Wang - IEEE Robotics and Automation …, 2022 - ieeexplore.ieee.org
Generalizable object manipulation skills are critical for intelligent and multi-functional robots
to work in real-world complex scenes. Despite the recent progress in reinforcement learning …