Generative models for learning robot manipulation skills from humans

AK Tanwani - 2018 - infoscience.epfl.ch
… We broadly address what-to-learn and how-to-learn problem in the context of robot learning …
The operator controls/teleoperates the remote arm with a simulated delay using the other …

[HTML][HTML] Robot learning from randomized simulations: A review

F Muratore, F Ramos, G Turk, W Yu… - Frontiers in Robotics …, 2022 - frontiersin.org
… These simulators are parameterized generative models, which describe how multiple
bodies or particles evolve over time by interacting with each other. The associated physics …

Gen2sim: Scaling up robot learning in simulation with generative models

P Katara, Z Xian, K Fragkiadaki - arXiv preprint arXiv:2310.18308, 2023 - arxiv.org
… towards scaling up robot learning across diverse tasks and environments. We propose
Generation to Simulation (Gen2Sim), a method for scaling up robot skill learning in simulation by …

Robogen: Towards unleashing infinite data for automated robot learning via generative simulation

Y Wang, Z Xian, F Chen, TH Wang, Y Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
… , a generative robotic agent that automatically learns diverse robotic skills at scale via generative
simulation… RoboGen leverages the latest advancements in foundation and generative

Gen2Sim: Scaling up Simulation with Generative Models for Robotic Skill Learning

P Katara, Z Xian, K Fragkiadaki - … Generalist Robots: Learning …, 2023 - openreview.net
… We believe generative models of images and language will play an important 350 … robot
training data in simulation, and in crossing the sim2real 351 gap, necessary for delivering robot

Multi-modal imitation learning from unstructured demonstrations using generative adversarial nets

K Hausman, Y Chebotar, S Schaal… - Advances in neural …, 2017 - proceedings.neurips.cc
robot learning frameworks that present promising results. These include: reinforcement learning
[31] - where a robot learns … on a series of challenging simulated robotics tasks described …

Closing the simulation-to-reality gap using generative neural networks: Training object detectors for soccer robotics in simulation as a case study

N Cruz, J Ruiz-del-Solar - 2020 International Joint Conference …, 2020 - ieeexplore.ieee.org
… the simulation-to-reality-gap, in this paper a methodology for the real-time generation of
realistic images in robotic simulation … Hadsell, “Sim-to-real robot learning from pixels with …

Evolving gaits for physical robots with the hyperneat generative encoding: The benefits of simulation

S Lee, J Yosinski, K Glette, H Lipson… - … 16th European Conference …, 2013 - Springer
… —with a different robot and simulator—previous work that has shown that HyperNEAT is an
effective encoding for automatically evolving coordinated, regular gaits in simulation [4, 7, 25]…

General robot dynamics learning and gen2real

D Xing, J Li, Y Yang, B Xu - arXiv preprint arXiv:2104.02402, 2021 - arxiv.org
Generative pre-training (GPT) is a transformer-based model … learning in the simulation
since they include enormous robot … lower the threshold, attracting beginners in robot learning. …

Rl-cyclegan: Reinforcement learning aware simulation-to-real

K Rao, C Harris, A Irpan, S Levine… - Proceedings of the …, 2020 - openaccess.thecvf.com
… automatically translate simulated observations into realistic ones via a generative adversarial
… We evaluate simulation-to-real methods for robotic grasping in a scenario where off-policy …