Supervised pretraining can learn in-context reinforcement learning

J Lee, A Xie, A Pacchiano, Y Chandak… - Advances in …, 2024 - proceedings.neurips.cc
Large transformer models trained on diverse datasets have shown a remarkable ability to
learn in-context, achieving high few-shot performance on tasks they were not explicitly …

A survey of meta-reinforcement learning

J Beck, R Vuorio, EZ Liu, Z Xiong, L Zintgraf… - arXiv preprint arXiv …, 2023 - arxiv.org
While deep reinforcement learning (RL) has fueled multiple high-profile successes in
machine learning, it is held back from more widespread adoption by its often poor data …

Rorl: Robust offline reinforcement learning via conservative smoothing

R Yang, C Bai, X Ma, Z Wang… - Advances in neural …, 2022 - proceedings.neurips.cc
Offline reinforcement learning (RL) provides a promising direction to exploit massive amount
of offline data for complex decision-making tasks. Due to the distribution shift issue, current …

Generalized decision transformer for offline hindsight information matching

H Furuta, Y Matsuo, SS Gu - arXiv preprint arXiv:2111.10364, 2021 - arxiv.org
How to extract as much learning signal from each trajectory data has been a key problem in
reinforcement learning (RL), where sample inefficiency has posed serious challenges for …

Deep reinforcement learning enabled physical-model-free two-timescale voltage control method for active distribution systems

D Cao, J Zhao, W Hu, N Yu, F Ding… - … on Smart Grid, 2021 - ieeexplore.ieee.org
Active distribution networks are being challenged by frequent and rapid voltage violations
due to renewable energy integration. Conventional model-based voltage control methods …

Transformers as decision makers: Provable in-context reinforcement learning via supervised pretraining

L Lin, Y Bai, S Mei - arXiv preprint arXiv:2310.08566, 2023 - arxiv.org
Large transformer models pretrained on offline reinforcement learning datasets have
demonstrated remarkable in-context reinforcement learning (ICRL) capabilities, where they …

Offline meta-reinforcement learning for industrial insertion

TZ Zhao, J Luo, O Sushkov… - … on robotics and …, 2022 - ieeexplore.ieee.org
Reinforcement learning (RL) can in principle let robots automatically adapt to new tasks, but
current RL methods require a large number of trials to accomplish this. In this paper, we …

Metadiffuser: Diffusion model as conditional planner for offline meta-rl

F Ni, J Hao, Y Mu, Y Yuan, Y Zheng… - International …, 2023 - proceedings.mlr.press
Recently, diffusion model shines as a promising backbone for the sequence modeling
paradigm in offline reinforcement learning (RL). However, these works mostly lack the …

Model-based meta reinforcement learning using graph structured surrogate models and amortized policy search

Q Wang, H Van Hoof - International Conference on Machine …, 2022 - proceedings.mlr.press
Reinforcement learning is a promising paradigm for solving sequential decision-making
problems, but low data efficiency and weak generalization across tasks are bottlenecks in …

Generalizable Task Representation Learning for Offline Meta-Reinforcement Learning with Data Limitations

R Zhou, CX Gao, Z Zhang, Y Yu - … of the AAAI Conference on Artificial …, 2024 - ojs.aaai.org
Generalization and sample efficiency have been long-standing issues concerning
reinforcement learning, and thus the field of Offline Meta-Reinforcement Learning (OMRL) …