Open x-embodiment: Robotic learning datasets and rt-x models

A Padalkar, A Pooley, A Jain, A Bewley… - arXiv preprint arXiv …, 2023 - arxiv.org
Large, high-capacity models trained on diverse datasets have shown remarkable successes
on efficiently tackling downstream applications. In domains from NLP to Computer Vision …

Rt-1: Robotics transformer for real-world control at scale

A Brohan, N Brown, J Carbajal, Y Chebotar… - arXiv preprint arXiv …, 2022 - arxiv.org
By transferring knowledge from large, diverse, task-agnostic datasets, modern machine
learning models can solve specific downstream tasks either zero-shot or with small task …

Pre-training for robots: Offline rl enables learning new tasks from a handful of trials

A Kumar, A Singh, F Ebert, M Nakamoto… - arXiv preprint arXiv …, 2022 - arxiv.org
Progress in deep learning highlights the tremendous potential of utilizing diverse robotic
datasets for attaining effective generalization and makes it enticing to consider leveraging …

Octo: An open-source generalist robot policy

OM Team, D Ghosh, H Walke, K Pertsch… - arXiv preprint arXiv …, 2024 - arxiv.org
Large policies pretrained on diverse robot datasets have the potential to transform robotic
learning: instead of training new policies from scratch, such generalist robot policies may be …

Can foundation models perform zero-shot task specification for robot manipulation?

Y Cui, S Niekum, A Gupta, V Kumar… - … for dynamics and …, 2022 - proceedings.mlr.press
Task specification is at the core of programming autonomous robots. A low-effort modality for
task specification is critical for engagement of non-expert end users and ultimate adoption of …

Bridge data: Boosting generalization of robotic skills with cross-domain datasets

F Ebert, Y Yang, K Schmeckpeper, B Bucher… - arXiv preprint arXiv …, 2021 - arxiv.org
Robot learning holds the promise of learning policies that generalize broadly. However,
such generalization requires sufficiently diverse datasets of the task of interest, which can be …

Robonet: Large-scale multi-robot learning

S Dasari, F Ebert, S Tian, S Nair, B Bucher… - arXiv preprint arXiv …, 2019 - arxiv.org
Robot learning has emerged as a promising tool for taming the complexity and diversity of
the real world. Methods based on high-capacity models, such as deep networks, hold the …

Generalization with lossy affordances: Leveraging broad offline data for learning visuomotor tasks

K Fang, P Yin, A Nair, HR Walke… - … on Robot Learning, 2023 - proceedings.mlr.press
The use of broad datasets has proven to be crucial for generalization for a wide range of
fields. However, how to effectively make use of diverse multi-task data for novel downstream …

Actionable models: Unsupervised offline reinforcement learning of robotic skills

Y Chebotar, K Hausman, Y Lu, T Xiao… - arXiv preprint arXiv …, 2021 - arxiv.org
We consider the problem of learning useful robotic skills from previously collected offline
data without access to manually specified rewards or additional online exploration, a setting …

Gnfactor: Multi-task real robot learning with generalizable neural feature fields

Y Ze, G Yan, YH Wu, A Macaluso… - … on Robot Learning, 2023 - proceedings.mlr.press
It is a long-standing problem in robotics to develop agents capable of executing diverse
manipulation tasks from visual observations in unstructured real-world environments. To …