Towards continual reinforcement learning: A review and perspectives

K Khetarpal, M Riemer, I Rish, D Precup - Journal of Artificial Intelligence …, 2022 - jair.org
In this article, we aim to provide a literature review of different formulations and approaches
to continual reinforcement learning (RL), also known as lifelong or non-stationary RL. We …

A survey of zero-shot generalisation in deep reinforcement learning

R Kirk, A Zhang, E Grefenstette, T Rocktäschel - Journal of Artificial …, 2023 - jair.org
The study of zero-shot generalisation (ZSG) in deep Reinforcement Learning (RL) aims to
produce RL algorithms whose policies generalise well to novel unseen situations at …

[PDF][PDF] Out-of-distribution detection for reinforcement learning agents with probabilistic dynamics models

T Haider, K Roscher, F Schmoeller da Roza… - Proceedings of the …, 2023 - ifaamas.org
Reliability of reinforcement learning (RL) agents is a largely unsolved problem. Especially in
situations that substantially differ from their training environment, RL agents often exhibit …

Rapid-learn: A framework for learning to recover for handling novelties in open-world environments

S Goel, Y Shukla, V Sarathy, M Scheutz… - … on Development and …, 2022 - ieeexplore.ieee.org
We propose RAPid-Learn (Learning to Recover and Plan Again), a hybrid planning and
learning method, to tackle the problem of adapting to sudden and unexpected changes in an …

The anticipatory paradigm

A Amos‐Binks, D Dannenhauer, LH Gilpin - AI Magazine, 2023 - Wiley Online Library
Anticipatory thinking is necessary for managing risk in the safety‐and mission‐critical
domains where AI systems are being deployed. We analyze the intersection of anticipatory …

Novgrid: A flexible grid world for evaluating agent response to novelty

J Balloch, Z Lin, M Hussain, A Srinivas, R Wright… - arXiv preprint arXiv …, 2022 - arxiv.org
A robust body of reinforcement learning techniques have been developed to solve complex
sequential decision making problems. However, these methods assume that train and …

A neurosymbolic cognitive architecture framework for handling novelties in open worlds

S Goel, P Lymperopoulos, R Thielstrom, E Krause… - Artificial Intelligence, 2024 - Elsevier
Abstract “Open world” environments are those in which novel objects, agents, events, and
more can appear and contradict previous understandings of the environment. This runs …

Creative problem solving in artificially intelligent agents: A survey and framework

E Gizzi, L Nair, S Chernova, J Sinapov - Journal of Artificial Intelligence …, 2022 - jair.org
Abstract Creative Problem Solving (CPS) is a sub-area within Artificial Intelligence (AI) that
focuses on methods for solving off-nominal, or anomalous problems in autonomous …

A domain-independent agent architecture for adaptive operation in evolving open worlds

S Mohan, W Piotrowski, R Stern, S Grover, S Kim… - Artificial Intelligence, 2024 - Elsevier
Abstract Model-based reasoning agents are ill-equipped to act in novel situations in which
their model of the environment no longer sufficiently represents the world. We propose …

Novphy: A testbed for physical reasoning in open-world environments

C Gamage, V Pinto, C Xue, P Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
Due to the emergence of AI systems that interact with the physical environment, there is an
increased interest in incorporating physical reasoning capabilities into those AI systems. But …