On the normative advantages of dopamine and striatal opponency for learning and choice

A Jaskir, MJ Frank - Elife, 2023 - elifesciences.org
The basal ganglia (BG) contribute to reinforcement learning (RL) and decision-making, but
unlike artificial RL agents, it relies on complex circuitry and dynamic dopamine modulation …

Learning the payoffs and costs of actions

M Möller, R Bogacz - PLoS computational biology, 2019 - journals.plos.org
A set of sub-cortical nuclei called basal ganglia is critical for learning the values of actions.
The basal ganglia include two pathways, which have been associated with approach and …

Dopaminergic control of the exploration-exploitation trade-off via the basal ganglia

MD Humphries, M Khamassi, K Gurney - Frontiers in neuroscience, 2012 - frontiersin.org
We continuously face the dilemma of choosing between actions that gather new information
or actions that exploit existing knowledge. This “exploration-exploitation” trade-off depends …

Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation

MJ Frank, BB Doll, J Oas-Terpstra, F Moreno - Nature neuroscience, 2009 - nature.com
The basal ganglia support learning to exploit decisions that have yielded positive outcomes
in the past. In contrast, limited evidence implicates the prefrontal cortex in the process of …

Dopamine-independent effect of rewards on choices through hidden-state inference

M Blanco-Pozo, T Akam, ME Walton - Nature Neuroscience, 2024 - nature.com
Dopamine is implicated in adaptive behavior through reward prediction error (RPE) signals
that update value estimates. There is also accumulating evidence that animals in structured …

Reinforcement learning: the good, the bad and the ugly

P Dayan, Y Niv - Current opinion in neurobiology, 2008 - Elsevier
Reinforcement learning provides both qualitative and quantitative frameworks for
understanding and modeling adaptive decision-making in the face of rewards and …

Multiplexing signals in reinforcement learning with internal models and dopamine

H Nakahara - Current opinion in neurobiology, 2014 - Elsevier
Highlights•Decision-making involves various uses of internal models, such as reflecting
reward structures.•Generalized prediction errors are used to improve value-based decision …

[HTML][HTML] The neurogenetics of exploration and exploitation: Prefrontal and striatal dopaminergic components

MJ Frank, BB Doll, J Oas-Terpstra… - Nature neuroscience, 2009 - ncbi.nlm.nih.gov
The basal ganglia support learning to exploit decisions that have yielded positive outcomes
in the past. In contrast, limited evidence implicates the prefrontal cortex for making strategic …

Choice-selective sequences dominate in cortical relative to thalamic inputs to NAc to support reinforcement learning

NF Parker, A Baidya, J Cox, LM Haetzel… - Cell reports, 2022 - cell.com
How are actions linked with subsequent outcomes to guide choices? The nucleus
accumbens, which is implicated in this process, receives glutamatergic inputs from the …

Believing in dopamine

SJ Gershman, N Uchida - Nature Reviews Neuroscience, 2019 - nature.com
Midbrain dopamine signals are widely thought to report reward prediction errors that drive
learning in the basal ganglia. However, dopamine has also been implicated in various …