Spatial action maps for mobile manipulation

J Wu, X Sun, A Zeng, S Song, J Lee… - arXiv preprint arXiv …, 2020 - arxiv.org
Typical end-to-end formulations for learning robotic navigation involve predicting a small set
of steering command actions (eg, step forward, turn left, turn right, etc.) from images of the …

Hierarchical Diffusion Policy for Kinematics-Aware Multi-Task Robotic Manipulation

X Ma, S Patidar, I Haughton… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Abstract This paper introduces Hierarchical Diffusion Policy (HDP) a hierarchical agent for
multi-task robotic manipulation. HDP factorises a manipulation policy into a hierarchical …

Grasping in the wild: Learning 6dof closed-loop grasping from low-cost demonstrations

S Song, A Zeng, J Lee… - IEEE Robotics and …, 2020 - ieeexplore.ieee.org
Intelligent manipulation benefits from the capacity to flexibly control an end-effector with high
degrees of freedom (DoF) and dynamically react to the environment. However, due to the …

Trends and challenges in robot manipulation

A Billard, D Kragic - Science, 2019 - science.org
BACKGROUND Humans have a fantastic ability to manipulate objects of various shapes,
sizes, and materials and can control the objects' position in confined spaces with the …

The Distracting Control Suite--A Challenging Benchmark for Reinforcement Learning from Pixels

A Stone, O Ramirez, K Konolige… - arXiv preprint arXiv …, 2021 - arxiv.org
Robots have to face challenging perceptual settings, including changes in viewpoint,
lighting, and background. Current simulated reinforcement learning (RL) benchmarks such …

[HTML][HTML] Learning mobile manipulation through deep reinforcement learning

C Wang, Q Zhang, Q Tian, S Li, X Wang, D Lane… - Sensors, 2020 - mdpi.com
Mobile manipulation has a broad range of applications in robotics. However, it is usually
more challenging than fixed-base manipulation due to the complex coordination of a mobile …

Roboagent: Generalization and efficiency in robot manipulation via semantic augmentations and action chunking

H Bharadhwaj, J Vakil, M Sharma, A Gupta… - arXiv preprint arXiv …, 2023 - arxiv.org
The grand aim of having a single robot that can manipulate arbitrary objects in diverse
settings is at odds with the paucity of robotics datasets. Acquiring and growing such datasets …

Vima: Robot manipulation with multimodal prompts

Y Jiang, A Gupta, Z Zhang, G Wang, Y Dou, Y Chen… - 2023 - openreview.net
Prompt-based learning has emerged as a successful paradigm in natural language
processing, where a single general-purpose language model can be instructed to perform …

What matters in learning from offline human demonstrations for robot manipulation

A Mandlekar, D Xu, J Wong, S Nasiriany… - arXiv preprint arXiv …, 2021 - arxiv.org
Imitating human demonstrations is a promising approach to endow robots with various
manipulation capabilities. While recent advances have been made in imitation learning and …

Universal manipulation policy network for articulated objects

Z Xu, Z He, S Song - IEEE robotics and automation letters, 2022 - ieeexplore.ieee.org
We introduce the Universal Manipulation Policy Network (UMPNet)–a single image-based
policy network that infers closed-loop action sequences for manipulating articulated objects …