Reinforcement learning in artificial and biological systems

EO Neftci, BB Averbeck - Nature Machine Intelligence, 2019 - nature.com
There is and has been a fruitful flow of concepts and ideas between studies of learning in
biological and artificial systems. Much early work that led to the development of …

Reinforcement-learning in fronto-striatal circuits

B Averbeck, JP O'Doherty - Neuropsychopharmacology, 2022 - nature.com
We review the current state of knowledge on the computational and neural mechanisms of
reinforcement-learning with a particular focus on fronto-striatal circuits. We divide the …

[HTML][HTML] Prefrontal cortex predicts state switches during reversal learning

R Bartolo, BB Averbeck - Neuron, 2020 - cell.com
Reinforcement learning allows organisms to predict future outcomes and to update their
beliefs about value in the world. The dorsal-lateral prefrontal cortex (dlPFC) integrates …

[HTML][HTML] Subcortical substrates of explore-exploit decisions in primates

VD Costa, AR Mitz, BB Averbeck - Neuron, 2019 - cell.com
The explore-exploit dilemma refers to the challenge of deciding when to forego immediate
rewards and explore new opportunities that could lead to greater rewards in the future …

[HTML][HTML] Divergent strategies for learning in males and females

CS Chen, RB Ebitz, SR Bindas, AD Redish, BY Hayden… - Current Biology, 2021 - cell.com
A frequent assumption in value-based decision-making tasks is that agents make decisions
based on the feature dimension that reward probabilities vary on. However, in complex …

Computational mechanisms underlying motivation to earn symbolic reinforcers

DC Burk, C Taswell, H Tang… - Journal of …, 2024 - Soc Neuroscience
Reinforcement learning is a theoretical framework that describes how agents learn to select
options that maximize rewards and minimize punishments over time. We often make …

[HTML][HTML] Mechanisms of adjustments to different types of uncertainty in the reward environment across mice and monkeys

JH Woo, CG Aguirre, BA Bari, KI Tsutsui… - Cognitive, Affective, & …, 2023 - Springer
Despite being unpredictable and uncertain, reward environments often exhibit certain
regularities, and animals navigating these environments try to detect and utilize such …

Multi-step planning in the brain

KJ Miller, SJC Venditto - Current Opinion in Behavioral Sciences, 2021 - Elsevier
Decisions in the natural world are rarely made in isolation. Each action that an organism
selects will affect the future situations in which it finds itself, and those situations will in turn …

Hypothalamic interactions with large-scale neural circuits underlying reinforcement learning and motivated behavior

BB Averbeck, EA Murray - Trends in neurosciences, 2020 - cell.com
Biological agents adapt behavior to support the survival needs of the individual and the
species. In this review we outline the anatomical, physiological, and computational …

Dopamine axons in dorsal striatum encode contralateral visual stimuli and choices

MM Moss, P Zatka-Haas, KD Harris… - Journal of …, 2021 - Soc Neuroscience
The striatum plays critical roles in visually-guided decision-making and receives dense
axonal projections from midbrain dopamine neurons. However, the roles of striatal …