Octo: An open-source generalist robot policy

OM Team, D Ghosh, H Walke, K Pertsch… - arXiv preprint arXiv …, 2024 - arxiv.org
Large policies pretrained on diverse robot datasets have the potential to transform robotic
learning: instead of training new policies from scratch, such generalist robot policies may be …

Robot learning in the era of foundation models: A survey

X Xiao, J Liu, Z Wang, Y Zhou, Y Qi, Q Cheng… - arXiv preprint arXiv …, 2023 - arxiv.org
The proliferation of Large Language Models (LLMs) has s fueled a shift in robot learning
from automation towards general embodied Artificial Intelligence (AI). Adopting foundation …

Human-in-the-loop task and motion planning for imitation learning

A Mandlekar, CR Garrett, D Xu… - Conference on Robot …, 2023 - proceedings.mlr.press
Imitation learning from human demonstrations can teach robots complex manipulation skills,
but is time-consuming and labor intensive. In contrast, Task and Motion Planning (TAMP) …

Robotgpt: Robot manipulation learning from chatgpt

Y Jin, D Li, A Yong, J Shi, P Hao, F Sun… - IEEE Robotics and …, 2024 - ieeexplore.ieee.org
We present RobotGPT, an innovative decision framework for robotic manipulation that
prioritizes stability and safety. The execution code generated by ChatGPT cannot guarantee …

NOD-TAMP: Multi-Step Manipulation Planning with Neural Object Descriptors

S Cheng, C Garrett, A Mandlekar, D Xu - arXiv preprint arXiv:2311.01530, 2023 - arxiv.org
Developing intelligent robots for complex manipulation tasks in household and factory
settings remains challenging due to long-horizon tasks, contact-rich manipulation, and the …

CyberDemo: Augmenting Simulated Human Demonstration for Real-World Dexterous Manipulation

J Wang, Y Qin, K Kuang, Y Korkmaz… - Proceedings of the …, 2024 - openaccess.thecvf.com
We introduce CyberDemo a novel approach to robotic imitation learning that leverages
simulated human demonstrations for real-world tasks. By incorporating extensive data …

The colosseum: A benchmark for evaluating generalization for robotic manipulation

W Pumacay, I Singh, J Duan, R Krishna… - arXiv preprint arXiv …, 2024 - arxiv.org
To realize effective large-scale, real-world robotic applications, we must evaluate how well
our robot policies adapt to changes in environmental conditions. Unfortunately, a majority of …

Mirage: Cross-Embodiment Zero-Shot Policy Transfer with Cross-Painting

LY Chen, K Hari, K Dharmarajan, C Xu… - arXiv preprint arXiv …, 2024 - arxiv.org
The ability to reuse collected data and transfer trained policies between robots could
alleviate the burden of additional data collection and training. While existing approaches …

Keep the Human in the Loop: Arguments for Human Assistance in the Synthesis of Simulation Data for Robot Training

C Liebers, P Megarajan, J Auda, TC Stratmann… - Multimodal …, 2024 - mdpi.com
Robot training often takes place in simulated environments, particularly with reinforcement
learning. Therefore, multiple training environments are generated using domain …

Extended residual learning with one-shot imitation learning for robotic assembly in semi-structured environment

C Wang, C Su, B Sun, G Chen, L Xie - Frontiers in Neurorobotics, 2024 - frontiersin.org
Introduction Robotic assembly tasks require precise manipulation and coordination, often
necessitating advanced learning techniques to achieve efficient and effective performance …