Open x-embodiment: Robotic learning datasets and rt-x models

A Padalkar, A Pooley, A Jain, A Bewley… - arXiv preprint arXiv …, 2023 - arxiv.org
Large, high-capacity models trained on diverse datasets have shown remarkable successes
on efficiently tackling downstream applications. In domains from NLP to Computer Vision …

Octo: An open-source generalist robot policy

OM Team, D Ghosh, H Walke, K Pertsch… - arXiv preprint arXiv …, 2024 - arxiv.org
Large policies pretrained on diverse robot datasets have the potential to transform robotic
learning: instead of training new policies from scratch, such generalist robot policies may be …

Mobile aloha: Learning bimanual mobile manipulation with low-cost whole-body teleoperation

Z Fu, TZ Zhao, C Finn - arXiv preprint arXiv:2401.02117, 2024 - arxiv.org
Imitation learning from human demonstrations has shown impressive performance in
robotics. However, most results focus on table-top manipulation, lacking the mobility and …

A Comprehensive Survey of Cross-Domain Policy Transfer for Embodied Agents

H Niu, J Hu, G Zhou, X Zhan - arXiv preprint arXiv:2402.04580, 2024 - arxiv.org
The burgeoning fields of robot learning and embodied AI have triggered an increasing
demand for large quantities of data. However, collecting sufficient unbiased data from the …

Learning Cross-hand Policies for High-DOF Reaching and Grasping

Q She, S Zhang, Y Ye, M Liu, R Hu, K Xu - arXiv preprint arXiv:2404.09150, 2024 - arxiv.org
Reaching-and-grasping is a fundamental skill for robotic manipulation, but existing methods
usually train models on a specific gripper and cannot be reused on another gripper without …

Pushing the Limits of Cross-Embodiment Learning for Manipulation and Navigation

J Yang, C Glossop, A Bhorkar, D Shah… - arXiv preprint arXiv …, 2024 - arxiv.org
Recent years in robotics and imitation learning have shown remarkable progress in training
large-scale foundation models by leveraging data across a multitude of embodiments. The …

Mirage: Cross-Embodiment Zero-Shot Policy Transfer with Cross-Painting

LY Chen, K Hari, K Dharmarajan, C Xu… - arXiv preprint arXiv …, 2024 - arxiv.org
The ability to reuse collected data and transfer trained policies between robots could
alleviate the burden of additional data collection and training. While existing approaches …

Affordance Blending Networks

H Aktas, Y Nagai, M Asada, E Oztop, E Ugur - arXiv preprint arXiv …, 2024 - arxiv.org
Affordances, a concept rooted in ecological psychology and pioneered by James J. Gibson,
have emerged as a fundamental framework for understanding the dynamic relationship …

Octo: An Open-Source Generalist Robot Policy

O Mees, D Ghosh, K Pertsch, K Black, HR Walke… - First Workshop on Vision … - openreview.net
Large policies pretrained on diverse robot datasets have the potential to transform robotic
learning: instead of training new policies from scratch, such generalist robot policies may be …