Transferring agent behaviors from videos via motion GANs

AD Edwards, CL Isbell Jr - arXiv preprint arXiv:1711.07676, 2017 - arxiv.org
A major bottleneck for developing general reinforcement learning agents is determining
rewards that will yield desirable behaviors under various circumstances. We introduce a …

Towards learning to imitate from a single video demonstration

G Berseth, F Golemo, C Pal - Journal of Machine Learning Research, 2023 - jmlr.org
Agents that can learn to imitate behaviours observed in video-without having direct access
to internal state or action information of the observed agent-are more suitable for learning in …

Adversarial motion priors make good substitutes for complex reward functions

A Escontrela, XB Peng, W Yu, T Zhang… - 2022 IEEE/RSJ …, 2022 - ieeexplore.ieee.org
Training a high-dimensional simulated agent with an under-specified reward function often
leads the agent to learn physically infeasible strategies that are ineffective when deployed in …

Generating diverse programs with instruction conditioned reinforced adversarial learning

A Agrawal, M Malinowski, F Hill, A Eslami… - arXiv preprint arXiv …, 2018 - arxiv.org
Advances in Deep Reinforcement Learning have led to agents that perform well across a
variety of sensory-motor domains. In this work, we study the setting in which an agent must …

Automatic goal generation for reinforcement learning agents

D Held, X Geng, C Florensa, P Abbeel - 2018 - openreview.net
Reinforcement learning (RL) is a powerful technique to train an agent to perform a task.
However, an agent that is trained using RL is only capable of achieving the single task that …

Finding and visualizing weaknesses of deep reinforcement learning agents

C Rupprecht, C Ibrahim, CJ Pal - arXiv preprint arXiv:1904.01318, 2019 - arxiv.org
As deep reinforcement learning driven by visual perception becomes more widely used
there is a growing need to better understand and probe the learned agents. Understanding …

Learning to simulate dynamic environments with gamegan

SW Kim, Y Zhou, J Philion… - Proceedings of the …, 2020 - openaccess.thecvf.com
Simulation is a crucial component of any robotic system. In order to simulate correctly, we
need to write complex rules of the environment: how dynamic agents behave, and how the …

Policy Disentangled Variational Autoencoder

TY Lim, K Lee, W Lim - openreview.net
Deep generative models for video primarily treat videos as visual representations of agents
(eg, people or objects) performing actions, often overlooking the underlying intentions …

Automatic goal generation for reinforcement learning agents

C Florensa, D Held, X Geng… - … conference on machine …, 2018 - proceedings.mlr.press
Reinforcement learning (RL) is a powerful technique to train an agent to perform a task;
however, an agent that is trained using RL is only capable of achieving the single task that is …

Reinforcement learning with videos: Combining offline observations with interaction

K Schmeckpeper, O Rybkin, K Daniilidis… - arXiv preprint arXiv …, 2020 - arxiv.org
Reinforcement learning is a powerful framework for robots to acquire skills from experience,
but often requires a substantial amount of online data collection. As a result, it is difficult to …