The algorithmic architecture of exploration in the human brain

E Schulz, SJ Gershman - Current opinion in neurobiology, 2019 - Elsevier
Highlights•Humans use uncertainty-based algorithms to balance exploration and
exploitation.•Humans utilize structure in the state space to make exploration more …

Cognition and addiction

A Verdejo-Garcia, G Garcia-Fernandez… - Dialogues in clinical …, 2019 - Taylor & Francis
In this targeted review, we summarize current knowledge on substance-use disorder (SUD)-
related cognitive deficits, the link between these deficits and clinical outcomes, and the …

A reinforcement learning diffusion decision model for value-based decisions

L Fontanesi, S Gluth, MS Spektor… - Psychonomic bulletin & …, 2019 - Springer
Psychological models of value-based decision-making describe how subjective values are
formed and mapped to single choices. Recently, additional efforts have been made to …

The geometry of domain-general performance monitoring in the human medial frontal cortex

Z Fu, D Beam, JM Chung, CM Reed, AN Mamelak… - Science, 2022 - science.org
Controlling behavior to flexibly achieve desired goals depends on the ability to monitor one's
own performance. It is unknown how performance monitoring can be both flexible, to support …

Willpower with and without effort

G Ainslie - Behavioral and Brain Sciences, 2021 - cambridge.org
Most authors who discuss willpower assume that everyone knows what it is, but our
assumptions differ to such an extent that we talk past each other. We agree that willpower is …

Pathways to the persistence of drug use despite its adverse consequences

GP McNally, P Jean-Richard-dit-Bressel… - Molecular …, 2023 - nature.com
The persistence of drug taking despite its adverse consequences plays a central role in the
presentation, diagnosis, and impacts of addiction. Eventual recognition and appraisal of …

Advances in modeling learning and decision-making in neuroscience

AGE Collins, A Shenhav - Neuropsychopharmacology, 2022 - nature.com
An organism's survival depends on its ability to learn about its environment and to make
adaptive decisions in the service of achieving the best possible outcomes in that …

Uncertainty and exploration.

SJ Gershman - Decision, 2019 - psycnet.apa.org
In order to discover the most rewarding actions, agents must collect information about their
environment, potentially foregoing reward. The optimal solution to this “explore–exploit” …

Dopamine regulates decision thresholds in human reinforcement learning in males

K Chakroun, A Wiehler, B Wagner, D Mathar… - Nature …, 2023 - nature.com
Dopamine fundamentally contributes to reinforcement learning, but recent accounts also
suggest a contribution to specific action selection mechanisms and the regulation of …

Improving the reliability of model-based decision-making estimates in the two-stage decision task with reaction-times and drift-diffusion modeling

N Shahar, TU Hauser, M Moutoussis… - PLoS computational …, 2019 - journals.plos.org
A well-established notion in cognitive neuroscience proposes that multiple brain systems
contribute to choice behaviour. These include:(1) a model-free system that uses values …