Generative skill chaining: Long-horizon skill planning with diffusion models

UA Mishra, S Xue, Y Chen… - Conference on Robot …, 2023 - proceedings.mlr.press
Long-horizon tasks, usually characterized by complex subtask dependencies, present a
significant challenge in manipulation planning. Skill chaining is a practical approach to …

Human-in-the-loop task and motion planning for imitation learning

A Mandlekar, CR Garrett, D Xu… - Conference on Robot …, 2023 - proceedings.mlr.press
Imitation learning from human demonstrations can teach robots complex manipulation skills,
but is time-consuming and labor intensive. In contrast, Task and Motion Planning (TAMP) …

Diffskill: Skill abstraction from differentiable physics for deformable object manipulations with tools

X Lin, Z Huang, Y Li, JB Tenenbaum, D Held… - arXiv preprint arXiv …, 2022 - arxiv.org
We consider the problem of sequential robotic manipulation of deformable objects using
tools. Previous works have shown that differentiable physics simulators provide gradients to …

Planning with spatial-temporal abstraction from point clouds for deformable object manipulation

X Lin, C Qi, Y Zhang, Z Huang, K Fragkiadaki… - arXiv preprint arXiv …, 2022 - arxiv.org
Effective planning of long-horizon deformable object manipulation requires suitable
abstractions at both the spatial and temporal levels. Previous methods typically either focus …

Generalizable task planning through representation pretraining

C Wang, D Xu, L Fei-Fei - IEEE Robotics and Automation …, 2022 - ieeexplore.ieee.org
The ability to plan for multi-step manipulation tasks in unseen situations is crucial for future
home robots. But collecting sufficient experience data for end-to-end learning is often …

Planning for multi-object manipulation with graph neural network relational classifiers

Y Huang, A Conkey, T Hermans - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
Objects rarely sit in isolation in human environments. As such, we'd like our robots to reason
about how multiple objects relate to one another and how those relations may change as the …

League: Guided skill learning and abstraction for long-horizon manipulation

S Cheng, D Xu - IEEE Robotics and Automation Letters, 2023 - ieeexplore.ieee.org
To assist with everyday human activities, robots must solve complex long-horizon tasks and
generalize to new settings. Recent deep reinforcement learning (RL) methods show promise …

NOD-TAMP: Multi-Step Manipulation Planning with Neural Object Descriptors

S Cheng, C Garrett, A Mandlekar, D Xu - arXiv preprint arXiv:2311.01530, 2023 - arxiv.org
Developing intelligent robots for complex manipulation tasks in household and factory
settings remains challenging due to long-horizon tasks, contact-rich manipulation, and the …

Synergistic task and motion planning with reinforcement learning-based non-prehensile actions

G Liu, J De Winter, D Steckelmacher… - IEEE Robotics and …, 2023 - ieeexplore.ieee.org
Robotic manipulation in cluttered environments requires synergistic planning among
prehensile and non-prehensile actions. Previous works on sampling-based Task and Motion …

Guided skill learning and abstraction for long-horizon manipulation

S Cheng, D Xu - Deep Reinforcement Learning Workshop NeurIPS …, 2022 - openreview.net
To assist with everyday human activities, robots must solve complex long-horizon tasks and
generalize to new settings. Recent deep reinforcement learning (RL) methods show …