CAGE: Controllable Articulation GEneration

J Liu, HII Tam, A Mahdavi-Amiri… - Proceedings of the …, 2024 - openaccess.thecvf.com
We address the challenge of generating 3D articulated objects in a controllable fashion.
Currently modeling articulated 3D objects is either achieved through laborious manual …

Roboscript: Code generation for free-form manipulation tasks across real and simulation

J Chen, Y Mu, Q Yu, T Wei, S Wu, Z Yuan… - arXiv preprint arXiv …, 2024 - arxiv.org
Rapid progress in high-level task planning and code generation for open-world robot
manipulation has been witnessed in Embodied AI. However, previous studies put much …

RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesis

Y Mu, J Chen, Q Zhang, S Chen, Q Yu, C Ge… - arXiv preprint arXiv …, 2024 - arxiv.org
Robotic behavior synthesis, the problem of understanding multimodal inputs and generating
precise physical control for robots, is an important part of Embodied AI. Despite successes in …

ManiPose: A Comprehensive Benchmark for Pose-aware Object Manipulation in Robotics

Q Yu, C Hao, J Wang, W Liu, L Liu, Y Mu, Y You… - arXiv preprint arXiv …, 2024 - arxiv.org
Robotic manipulation in everyday scenarios, especially in unstructured environments,
requires skills in pose-aware object manipulation (POM), which adapts robots' grasping and …

UniAff: A Unified Representation of Affordances for Tool Usage and Articulation with Vision-Language Models

Q Yu, S Huang, X Yuan, Z Jiang, C Hao, X Li… - arXiv preprint arXiv …, 2024 - arxiv.org
Previous studies on robotic manipulation are based on a limited understanding of the
underlying 3D motion constraints and affordances. To address these challenges, we …

Generalizable Articulated Object Perception with Superpoints

Q Yu, C Hao, X Yuan, L Zhang, L Liu, Y Huo… - arXiv preprint arXiv …, 2024 - arxiv.org
Manipulating articulated objects with robotic arms is challenging due to the complex
kinematic structure, which requires precise part segmentation for efficient manipulation. In …

PhyGrasp: Generalizing Robotic Grasping with Physics-informed Large Multimodal Models

D Guo, Y Xiang, S Zhao, X Zhu, M Tomizuka… - arXiv preprint arXiv …, 2024 - arxiv.org
Robotic grasping is a fundamental aspect of robot functionality, defining how robots interact
with objects. Despite substantial progress, its generalizability to counter-intuitive or long …

RPMArt: Towards Robust Perception and Manipulation for Articulated Objects

J Wang, W Liu, Q Yu, Y You, L Liu, W Wang… - arXiv preprint arXiv …, 2024 - arxiv.org
Articulated objects are commonly found in daily life. It is essential that robots can exhibit
robust perception and manipulation skills for articulated objects in real-world robotic …

Rethinking 3D Convolution in -norm Space

L Zhang, Y Zhong, J Wang, Z Min, L Liu - The Thirty-eighth Annual … - openreview.net
Convolution is a fundamental operation in the 3D backbone. However, under certain
conditions, the feature extraction ability of traditional convolution methods may be …

MIDGArD: Modular Interpretable Diffusion over Graphs for Articulated Designs

Q Leboutet, N Wiedemann, M Paulitsch… - The Thirty-eighth Annual … - openreview.net
Providing functionality through articulation and interaction with objects is a key objective in
3D generation. We introduce MIDGArD (Modular Interpretable Diffusion over Graphs for …