On the normative advantages of dopamine and striatal opponency for learning and choice
The basal ganglia (BG) contribute to reinforcement learning (RL) and decision-making, but
unlike artificial RL agents, it relies on complex circuitry and dynamic dopamine modulation …
unlike artificial RL agents, it relies on complex circuitry and dynamic dopamine modulation …
Learning the payoffs and costs of actions
A set of sub-cortical nuclei called basal ganglia is critical for learning the values of actions.
The basal ganglia include two pathways, which have been associated with approach and …
The basal ganglia include two pathways, which have been associated with approach and …
Dopaminergic control of the exploration-exploitation trade-off via the basal ganglia
We continuously face the dilemma of choosing between actions that gather new information
or actions that exploit existing knowledge. This “exploration-exploitation” trade-off depends …
or actions that exploit existing knowledge. This “exploration-exploitation” trade-off depends …
Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation
The basal ganglia support learning to exploit decisions that have yielded positive outcomes
in the past. In contrast, limited evidence implicates the prefrontal cortex in the process of …
in the past. In contrast, limited evidence implicates the prefrontal cortex in the process of …
Dopamine-independent effect of rewards on choices through hidden-state inference
M Blanco-Pozo, T Akam, ME Walton - Nature Neuroscience, 2024 - nature.com
Dopamine is implicated in adaptive behavior through reward prediction error (RPE) signals
that update value estimates. There is also accumulating evidence that animals in structured …
that update value estimates. There is also accumulating evidence that animals in structured …
Reinforcement learning: the good, the bad and the ugly
P Dayan, Y Niv - Current opinion in neurobiology, 2008 - Elsevier
Reinforcement learning provides both qualitative and quantitative frameworks for
understanding and modeling adaptive decision-making in the face of rewards and …
understanding and modeling adaptive decision-making in the face of rewards and …
Multiplexing signals in reinforcement learning with internal models and dopamine
H Nakahara - Current opinion in neurobiology, 2014 - Elsevier
Highlights•Decision-making involves various uses of internal models, such as reflecting
reward structures.•Generalized prediction errors are used to improve value-based decision …
reward structures.•Generalized prediction errors are used to improve value-based decision …
[HTML][HTML] The neurogenetics of exploration and exploitation: Prefrontal and striatal dopaminergic components
MJ Frank, BB Doll, J Oas-Terpstra… - Nature neuroscience, 2009 - ncbi.nlm.nih.gov
The basal ganglia support learning to exploit decisions that have yielded positive outcomes
in the past. In contrast, limited evidence implicates the prefrontal cortex for making strategic …
in the past. In contrast, limited evidence implicates the prefrontal cortex for making strategic …
Choice-selective sequences dominate in cortical relative to thalamic inputs to NAc to support reinforcement learning
How are actions linked with subsequent outcomes to guide choices? The nucleus
accumbens, which is implicated in this process, receives glutamatergic inputs from the …
accumbens, which is implicated in this process, receives glutamatergic inputs from the …
Believing in dopamine
SJ Gershman, N Uchida - Nature Reviews Neuroscience, 2019 - nature.com
Midbrain dopamine signals are widely thought to report reward prediction errors that drive
learning in the basal ganglia. However, dopamine has also been implicated in various …
learning in the basal ganglia. However, dopamine has also been implicated in various …