Explaining dopamine through prediction errors and beyond

SJ Gershman, JA Assad, SR Datta, SW Linderman… - Nature …, 2024 - nature.com
The most influential account of phasic dopamine holds that it reports reward prediction
errors (RPEs). The RPE-based interpretation of dopamine signaling is, in its original form …

Dopamine, updated: reward prediction error and beyond

TN Lerner, AL Holloway, JL Seiler - Current opinion in neurobiology, 2021 - Elsevier
Highlights•Reward Prediction Error (RPE) remains a compelling theory accounting for VTA
dopamine neuron activity•RPE theory now incorporates sensory prediction errors …

Wave-like dopamine dynamics as a mechanism for spatiotemporal credit assignment

AA Hamid, MJ Frank, CI Moore - Cell, 2021 - cell.com
Significant evidence supports the view that dopamine shapes learning by encoding reward
prediction errors. However, it is unknown whether striatal targets receive tailored dopamine …

A unified framework for dopamine signals across timescales

HGR Kim, AN Malik, JG Mikhael, P Bech… - Cell, 2020 - cell.com
Rapid phasic activity of midbrain dopamine neurons is thought to signal reward prediction
errors (RPEs), resembling temporal difference errors used in machine learning. However …

Reward expectation extinction restructures and degrades CA1 spatial maps through loss of a dopaminergic reward proximity signal

S Krishnan, C Heer, C Cherian, MEJ Sheffield - Nature communications, 2022 - nature.com
Hippocampal place cells support reward-related spatial memories by forming a cognitive
map that over-represents reward locations. The strength of these memories is modulated by …

A mosaic of cost–benefit control over cortico-striatal circuitry

A Westbrook, MJ Frank, R Cools - Trends in Cognitive Sciences, 2021 - cell.com
Dopamine contributes to cognitive control through well-established effects in both the
striatum and cortex. Although earlier work suggests that dopamine affects cognitive control …

Dual credit assignment processes underlie dopamine signals in a complex spatial environment

TA Krausz, AE Comrie, AE Kahn, LM Frank, ND Daw… - Neuron, 2023 - cell.com
Animals frequently make decisions based on expectations of future reward (" values").
Values are updated by ongoing experience: places and choices that result in reward are …

Slowly evolving dopaminergic activity modulates the moment-to-moment probability of reward-related self-timed movements

AE Hamilos, G Spedicato, Y Hong, F Sun, Y Li… - Elife, 2021 - elifesciences.org
Clues from human movement disorders have long suggested that the neurotransmitter
dopamine plays a role in motor control, but how the endogenous dopaminergic system …

Midbrain dopamine neurons signal phasic and ramping reward prediction error during goal-directed navigation

K Farrell, A Lak, AB Saleem - Cell Reports, 2022 - cell.com
Goal-directed navigation requires learning to accurately estimate location and select optimal
actions in each location. Midbrain dopamine neurons are involved in reward value learning …

Dopamine encodes real-time reward availability and transitions between reward availability states on different timescales

A Kalmbach, V Winiger, N Jeong, A Asok… - Nature …, 2022 - nature.com
Optimal behavior requires interpreting environmental cues that indicate when to perform
actions. Dopamine is important for learning about reward-predicting events, but its role in …