The successor representation: its computational logic and neural substrates

SJ Gershman - Journal of Neuroscience, 2018 - Soc Neuroscience
Reinforcement learning is the process by which an agent learns to predict long-term future
reward. We now understand a great deal about the brain's reinforcement learning …

Learning structures: predictive representations, replay, and generalization

I Momennejad - Current Opinion in Behavioral Sciences, 2020 - Elsevier
Memory and planning rely on learning the structure of relationships among experiences.
Compact representations of these structures guide flexible behavior in humans and animals …

Hierarchical deep reinforcement learning: Integrating temporal abstraction and intrinsic motivation

TD Kulkarni, K Narasimhan, A Saeedi… - Advances in neural …, 2016 - proceedings.neurips.cc
Learning goal-directed behavior in environments with sparse feedback is a major challenge
for reinforcement learning algorithms. One of the key difficulties is insufficient exploration …

[图书][B] Surfing uncertainty: Prediction, action, and the embodied mind

A Clark - 2015 - books.google.com
How is it that thoroughly physical material beings such as ourselves can think, dream, feel,
create and understand ideas, theories and concepts? How does mere matter give rise to all …

[HTML][HTML] Toward an integration of deep learning and neuroscience

AH Marblestone, G Wayne, KP Kording - Frontiers in computational …, 2016 - frontiersin.org
Neuroscience has focused on the detailed implementation of computation, studying neural
codes, dynamics and circuits. In machine learning, however, artificial neural networks tend …

The hippocampus as a predictive map

KL Stachenfeld, MM Botvinick, SJ Gershman - Nature neuroscience, 2017 - nature.com
A cognitive map has long been the dominant metaphor for hippocampal function, embracing
the idea that place cells encode a geometric representation of space. However, evidence for …

The successor representation in human reinforcement learning

I Momennejad, EM Russek, JH Cheong… - Nature human …, 2017 - nature.com
Theories of reward learning in neuroscience have focused on two families of algorithms
thought to capture deliberative versus habitual choice.'Model-based'algorithms compute the …

Predictive representations can link model-based reinforcement learning to model-free mechanisms

EM Russek, I Momennejad, MM Botvinick… - PLoS computational …, 2017 - journals.plos.org
Humans and animals are capable of evaluating actions by considering their long-run future
rewards through a process described using model-based reinforcement learning (RL) …

Deep successor reinforcement learning

TD Kulkarni, A Saeedi, S Gautam… - arXiv preprint arXiv …, 2016 - arxiv.org
Learning robust value functions given raw observations and rewards is now possible with
model-free and model-based deep reinforcement learning algorithms. There is a third …

Place cells may simply be memory cells: Memory compression leads to spatial tuning and history dependence

MK Benna, S Fusi - … of the National Academy of Sciences, 2021 - National Acad Sciences
The observation of place cells has suggested that the hippocampus plays a special role in
encoding spatial information. However, place cell responses are modulated by several …