Accelerating reinforcement learning with learned skill priors

K Pertsch, Y Lee, J Lim - Conference on robot learning, 2021 - proceedings.mlr.press
Intelligent agents rely heavily on prior experience when learning a new task, yet most
modern reinforcement learning (RL) approaches learn every task from scratch. One …

Guided reinforcement learning with learned skills

K Pertsch, Y Lee, Y Wu, JJ Lim - arXiv preprint arXiv:2107.10253, 2021 - arxiv.org
Demonstration-guided reinforcement learning (RL) is a promising approach for learning
complex behaviors by leveraging both reward feedback and a set of target task …

Bottom-up skill discovery from unsegmented demonstrations for long-horizon robot manipulation

Y Zhu, P Stone, Y Zhu - IEEE Robotics and Automation Letters, 2022 - ieeexplore.ieee.org
We tackle real-world long-horizon robot manipulation tasks through skill discovery. We
present a bottom-up approach to learning a library of reusable skills from unsegmented …

Long-horizon visual planning with goal-conditioned hierarchical predictors

K Pertsch, O Rybkin, F Ebert, S Zhou… - Advances in …, 2020 - proceedings.neurips.cc
The ability to predict and plan into the future is fundamental for agents acting in the world. To
reach a faraway goal, we predict trajectories at multiple timescales, first devising a coarse …

Variational temporal abstraction

T Kim, S Ahn, Y Bengio - Advances in Neural Information …, 2019 - proceedings.neurips.cc
We introduce a variational approach to learning and inference of temporally hierarchical
structure and representation for sequential data. We propose the Variational Temporal …

Efficient reinforcement learning for autonomous driving with parameterized skills and priors

L Wang, J Liu, H Shao, W Wang, R Chen, Y Liu… - arXiv preprint arXiv …, 2023 - arxiv.org
When autonomous vehicles are deployed on public roads, they will encounter countless and
diverse driving situations. Many manually designed driving policies are difficult to scale to …

Accelerating reinforcement learning for autonomous driving using task-agnostic and ego-centric motion skills

T Zhou, L Wang, R Chen, W Wang… - 2023 IEEE/RSJ …, 2023 - ieeexplore.ieee.org
Efficient and effective exploration in continuous space is a central problem in applying
reinforcement learning (RL) to autonomous driving. Skills learned from expert …

Keyframing the future: Keyframe discovery for visual prediction and planning

K Pertsch, O Rybkin, J Yang, S Zhou… - … for Dynamics and …, 2020 - proceedings.mlr.press
To flexibly and efficiently reason about dynamics of temporal sequences, abstract
representations that compactly represent the important information in the sequence are …

Learning world graphs to accelerate hierarchical reinforcement learning

W Shang, A Trott, S Zheng, C Xiong… - arXiv preprint arXiv …, 2019 - arxiv.org
In many real-world scenarios, an autonomous agent often encounters various tasks within a
single complex environment. We propose to build a graph abstraction over the environment …

On actions that matter: Credit assignment and interpretability in reinforcement learning

J Ferret - 2022 - theses.hal.science
This thesis, written for the qualification of Doctor of Philosophy in Computer Science, studies
the question of the individual importance of actions in sequential decision-making, through …