Towards a foundation model for generalist robots: Diverse skill learning at scale via automated task and scene generation

Z Xian, T Gervet, Z Xu, YL Qiao, TH Wang - arXiv preprint arXiv …, 2023 - arxiv.org
This document serves as a position paper that outlines the authors' vision for a potential
pathway towards generalist robots. The purpose of this document is to share the excitement …

Dexterous robotic manipulation using deep reinforcement learning and knowledge transfer for complex sparse reward‐based tasks

Q Wang, FR Sanchez, R McCarthy, DC Bulens… - Expert …, 2023 - Wiley Online Library
This paper describes a deep reinforcement learning (DRL) approach that won Phase 1 of
the Real Robot Challenge (RRC) 2021, and then extends this method to a more difficult …

Learning to compose hierarchical object-centric controllers for robotic manipulation

M Sharma, J Liang, J Zhao, A LaGrassa… - arXiv preprint arXiv …, 2020 - arxiv.org
Manipulation tasks can often be decomposed into multiple subtasks performed in parallel,
eg, sliding an object to a goal pose while maintaining contact with a table. Individual …

Robotgpt: Robot manipulation learning from chatgpt

Y Jin, D Li, A Yong, J Shi, P Hao, F Sun… - IEEE Robotics and …, 2024 - ieeexplore.ieee.org
We present RobotGPT, an innovative decision framework for robotic manipulation that
prioritizes stability and safety. The execution code generated by ChatGPT cannot guarantee …

Arraybot: Reinforcement learning for generalizable distributed manipulation through touch

Z Xue, H Zhang, J Cheng, Z He, Y Ju, C Lin… - arXiv preprint arXiv …, 2023 - arxiv.org
We present ArrayBot, a distributed manipulation system consisting of a $16\times 16$ array
of vertically sliding pillars integrated with tactile sensors, which can simultaneously support …

The treachery of images: Bayesian scene keypoints for deep policy learning in robotic manipulation

JO von Hartz, E Chisari, T Welschehold… - IEEE Robotics and …, 2023 - ieeexplore.ieee.org
In policy learning for robotic manipulation, sample efficiency is of paramount importance.
Thus, learning and extracting more compact representations from camera observations is a …

Dexpbt: Scaling up dexterous manipulation for hand-arm systems with population based training

A Petrenko, A Allshire, G State, A Handa… - arXiv preprint arXiv …, 2023 - arxiv.org
In this work, we propose algorithms and methods that enable learning dexterous object
manipulation using simulated one-or two-armed robots equipped with multi-fingered hand …

An open-source multi-goal reinforcement learning environment for robotic manipulation with pybullet

X Yang, Z Ji, J Wu, YK Lai - Annual Conference Towards Autonomous …, 2021 - Springer
This work re-implements the OpenAI Gym multi-goal robotic manipulation environment,
originally based on the commercial Mujoco engine, onto the open-source Pybullet engine …

Robocook: Long-horizon elasto-plastic object manipulation with diverse tools

H Shi, H Xu, S Clarke, Y Li, J Wu - arXiv preprint arXiv:2306.14447, 2023 - arxiv.org
Humans excel in complex long-horizon soft body manipulation tasks via flexible tool use:
bread baking requires a knife to slice the dough and a rolling pin to flatten it. Often regarded …

Deep object-centric representations for generalizable robot learning

C Devin, P Abbeel, T Darrell… - 2018 IEEE International …, 2018 - ieeexplore.ieee.org
Robotic manipulation in complex open-world scenarios requires both reliable physical
manipulation skills and effective and generalizable perception. In this paper, we propose …