Octo: An open-source generalist robot policy

OM Team, D Ghosh, H Walke, K Pertsch… - arXiv preprint arXiv …, 2024 - arxiv.org
Large policies pretrained on diverse robot datasets have the potential to transform robotic
learning: instead of training new policies from scratch, such generalist robot policies may be …

Mimicgen: A data generation system for scalable robot learning using human demonstrations

A Mandlekar, S Nasiriany, B Wen, I Akinola… - arXiv preprint arXiv …, 2023 - arxiv.org
Imitation learning from a large set of human demonstrations has proved to be an effective
paradigm for building capable robot agents. However, the demonstrations can be extremely …

Data quality in imitation learning

S Belkhale, Y Cui, D Sadigh - Advances in Neural …, 2024 - proceedings.neurips.cc
In supervised learning, the question of data quality and curation has been sidelined in
recent years in favor of increasingly more powerful and expressive models that can ingest …

Learning generalizable manipulation policies with object-centric 3d representations

Y Zhu, Z Jiang, P Stone, Y Zhu - arXiv preprint arXiv:2310.14386, 2023 - arxiv.org
We introduce GROOT, an imitation learning method for learning robust policies with object-
centric and 3D priors. GROOT builds policies that generalize beyond their initial training …

Accelerating exploration with unlabeled prior data

Q Li, J Zhang, D Ghosh, A Zhang… - Advances in Neural …, 2024 - proceedings.neurips.cc
Learning to solve tasks from a sparse reward signal is a major challenge for standard
reinforcement learning (RL) algorithms. However, in the real world, agents rarely need to …

Noir: Neural signal operated intelligent robots for everyday activities

R Zhang, S Lee, M Hwang, A Hiranaka, C Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
We present Neural Signal Operated Intelligent Robots (NOIR), a general-purpose, intelligent
brain-robot interface system that enables humans to command robots to perform everyday …

Deep generative models for offline policy learning: Tutorial, survey, and perspectives on future directions

J Chen, B Ganguly, Y Xu, Y Mei, T Lan… - arXiv preprint arXiv …, 2024 - arxiv.org
Deep generative models (DGMs) have demonstrated great success across various domains,
particularly in generating texts, images, and videos using models trained from offline data …

Behavior retrieval: Few-shot imitation learning by querying unlabeled datasets

M Du, S Nair, D Sadigh, C Finn - arXiv preprint arXiv:2304.08742, 2023 - arxiv.org
Enabling robots to learn novel visuomotor skills in a data-efficient manner remains an
unsolved problem with myriad challenges. A popular paradigm for tackling this problem is …

Plex: Making the most of the available data for robotic manipulation pretraining

G Thomas, CA Cheng, R Loynd… - … on Robot Learning, 2023 - proceedings.mlr.press
A rich representation is key to general robotic manipulation, but existing approaches to
representation learning require large amounts of multimodal demonstrations. In this work we …

Deep imitation learning for humanoid loco-manipulation through human teleoperation

M Seo, S Han, K Sim, SH Bang… - 2023 IEEE-RAS …, 2023 - ieeexplore.ieee.org
We tackle the problem of developing humanoid loco-manipulation skills with deep imitation
learning. The difficulty of collecting task demonstrations and training policies for humanoids …