Robot learning on the job: Human-in-the-loop autonomy and learning during deployment

H Liu, S Nasiriany, L Zhang, Z Bao, Y Zhu - arXiv preprint arXiv …, 2022 - arxiv.org
With the rapid growth of computing powers and recent advances in deep learning, we have
witnessed impressive demonstrations of novel robot capabilities in research settings …

Augmenting reinforcement learning with behavior primitives for diverse manipulation tasks

S Nasiriany, H Liu, Y Zhu - 2022 International Conference on …, 2022 - ieeexplore.ieee.org
Realistic manipulation tasks require a robot to interact with an environment with a prolonged
sequence of motor actions. While deep reinforcement learning methods have recently …

Dexart: Benchmarking generalizable dexterous manipulation with articulated objects

C Bao, H Xu, Y Qin, X Wang - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
To enable general-purpose robots, we will require the robot to operate daily articulated
objects as humans do. Current robot manipulation has heavily relied on using a parallel …

Giving robots a hand: Learning generalizable manipulation with eye-in-hand human video demonstrations

MJ Kim, J Wu, C Finn - arXiv preprint arXiv:2307.05959, 2023 - arxiv.org
Eye-in-hand cameras have shown promise in enabling greater sample efficiency and
generalization in vision-based robotic manipulation. However, for robotic imitation, it is still …

Manipulate by seeing: Creating manipulation controllers from pre-trained representations

J Wang, S Dasari, MK Srirama… - Proceedings of the …, 2023 - openaccess.thecvf.com
The field of visual representation learning has seen explosive growth in the past years, but
its benefits in robotics have been surprisingly limited so far. Prior work uses generic visual …

Iris: Implicit reinforcement without interaction at scale for learning control from offline robot manipulation data

A Mandlekar, F Ramos, B Boots… - … on Robotics and …, 2020 - ieeexplore.ieee.org
Learning from offline task demonstrations is a problem of great interest in robotics. For
simple short-horizon manipulation tasks with modest variation in task instances, offline …

Transporter networks: Rearranging the visual world for robotic manipulation

A Zeng, P Florence, J Tompson… - … on Robot Learning, 2021 - proceedings.mlr.press
Robotic manipulation can be formulated as inducing a sequence of spatial displacements:
where the space being moved can encompass an object, part of an object, or end effector. In …

Generalization in dexterous manipulation via geometry-aware multi-task learning

W Huang, I Mordatch, P Abbeel, D Pathak - arXiv preprint arXiv …, 2021 - arxiv.org
Dexterous manipulation of arbitrary objects, a fundamental daily task for humans, has been
a grand challenge for autonomous robotic systems. Although data-driven approaches using …

Robocat: A self-improving foundation agent for robotic manipulation

K Bousmalis, G Vezzani, D Rao, C Devin… - arXiv preprint arXiv …, 2023 - arxiv.org
The ability to leverage heterogeneous robotic experience from different robots and tasks to
quickly master novel skills and embodiments has the potential to transform robot learning …

Learning generalizable tool-use skills through trajectory generation

C Qi, S Shetty, X Lin, D Held - arXiv preprint arXiv:2310.00156, 2023 - arxiv.org
Autonomous systems that efficiently utilize tools can assist humans in completing many
common tasks such as cooking and cleaning. However, current systems fall short of …