Polybot: Training one policy across robots while embracing variability

J Yang, D Sadigh, C Finn - arXiv preprint arXiv:2307.03719, 2023 - arxiv.org
Reusing large datasets is crucial to scale vision-based robotic manipulators to everyday
scenarios due to the high cost of collecting robotic datasets. However, robotic platforms …

Octo: An open-source generalist robot policy

OM Team, D Ghosh, H Walke, K Pertsch… - arXiv preprint arXiv …, 2024 - arxiv.org
Large policies pretrained on diverse robot datasets have the potential to transform robotic
learning: instead of training new policies from scratch, such generalist robot policies may be …

Droid: A large-scale in-the-wild robot manipulation dataset

A Khazatsky, K Pertsch, S Nair, A Balakrishna… - arXiv preprint arXiv …, 2024 - arxiv.org
The creation of large, diverse, high-quality robot manipulation datasets is an important
stepping stone on the path toward more capable and robust robotic manipulation policies …

OPEN TEACH: A Versatile Teleoperation System for Robotic Manipulation

A Iyer, Z Peng, Y Dai, I Guzey, S Haldar… - arXiv preprint arXiv …, 2024 - arxiv.org
Open-sourced, user-friendly tools form the bedrock of scientific advancement across
disciplines. The widespread adoption of data-driven learning has led to remarkable …

Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robots

C Chi, Z Xu, C Pan, E Cousineau, B Burchfiel… - arXiv preprint arXiv …, 2024 - arxiv.org
We present Universal Manipulation Interface (UMI)--a data collection and policy learning
framework that allows direct skill transfer from in-the-wild human demonstrations to …

Transporter networks: Rearranging the visual world for robotic manipulation

A Zeng, P Florence, J Tompson… - … on Robot Learning, 2021 - proceedings.mlr.press
Robotic manipulation can be formulated as inducing a sequence of spatial displacements:
where the space being moved can encompass an object, part of an object, or end effector. In …

Vision-based manipulators need to also see from their hands

K Hsu, MJ Kim, R Rafailov, J Wu, C Finn - arXiv preprint arXiv:2203.12677, 2022 - arxiv.org
We study how the choice of visual perspective affects learning and generalization in the
context of physical manipulation from raw sensor observations. Compared with the more …

Manipulate by seeing: Creating manipulation controllers from pre-trained representations

J Wang, S Dasari, MK Srirama… - Proceedings of the …, 2023 - openaccess.thecvf.com
The field of visual representation learning has seen explosive growth in the past years, but
its benefits in robotics have been surprisingly limited so far. Prior work uses generic visual …

Learning to combine primitive skills: A step towards versatile robotic manipulation §

R Strudel, A Pashevich, I Kalevatykh… - … on Robotics and …, 2020 - ieeexplore.ieee.org
Manipulation tasks such as preparing a meal or assembling furniture remain highly
challenging for robotics and vision. Traditional task and motion planning (TAMP) methods …

Efficient adaptation for end-to-end vision-based robotic manipulation

R Julian, B Swanson, GS Sukhatme… - 4th Lifelong Machine …, 2020 - openreview.net
One of the great promises of robot learning systems is that they will be able to learn from
their mistakes and continuously adapt to ever-changing environments, but most robot …