Do RNN and LSTM have long memory?

J Zhao, F Huang, J Lv, Y Duan, Z Qin… - International …, 2020 - proceedings.mlr.press
The LSTM network was proposed to overcome the difficulty in learning long-term
dependence, and has made significant advancements in applications. With its success and …

Amrl: Aggregated memory for reinforcement learning

J Beck, K Ciosek, S Devlin, S Tschiatschek… - International …, 2020 - openreview.net
In many partially observable scenarios, Reinforcement Learning (RL) agents must rely on
long-term memory in order to learn an optimal policy. We demonstrate that using techniques …

Deep reinforcement learning with modulated Hebbian plus Q-network architecture

P Ladosz, E Ben-Iwhiwhu, J Dick, N Ketz… - … on Neural Networks …, 2021 - ieeexplore.ieee.org
In this article, we consider a subclass of partially observable Markov decision process
(POMDP) problems which we termed confounding POMDPs. In these types of POMDPs …

Combining slow and fast: complementary filtering for dynamics learning

K Ensinger, S Ziesche, B Rakitsch, M Tiemann… - Proceedings of the …, 2023 - ojs.aaai.org
Modeling an unknown dynamical system is crucial in order to predict the future behavior of
the system. A standard approach is training recurrent models on measurement data. While …

[PDF][PDF] Improving Population-Based Training for Neural Networks

T Angeland - 2020 - hiof.brage.unit.no
In recent years, there has been a rise in complex and computationally expensive machine
learning systems with many hyperparameters, such as deep convolutional neural networks …