Reinforcement learning in artificial and biological systems

EO Neftci, BB Averbeck - Nature Machine Intelligence, 2019 - nature.com
There is and has been a fruitful flow of concepts and ideas between studies of learning in
biological and artificial systems. Much early work that led to the development of …

Adaptive learning under expected and unexpected uncertainty

A Soltani, A Izquierdo - Nature Reviews Neuroscience, 2019 - nature.com
The outcome of a decision is often uncertain, and outcomes can vary over repeated
decisions. Whether decision outcomes should substantially affect behaviour and learning …

Meta-reinforcement learning via orbitofrontal cortex

R Hattori, NG Hedrick, A Jain, S Chen, H You… - Nature …, 2023 - nature.com
The meta-reinforcement learning (meta-RL) framework, which involves RL over multiple
timescales, has been successful in training deep RL models that generalize to new …

Striatal dopamine signals reflect perceived cue–action–outcome associations in mice

TW Bernklau, B Righetti, LS Mehrke, SN Jacob - Nature Neuroscience, 2024 - nature.com
Striatal dopamine drives associative learning by acting as a teaching signal. Much work has
focused on simple learning paradigms, including Pavlovian and instrumental learning …

Fear-neuro-inspired reinforcement learning for safe autonomous driving

X He, J Wu, Z Huang, Z Hu, J Wang… - IEEE transactions on …, 2023 - ieeexplore.ieee.org
Ensuring safety and achieving human-level driving performance remain challenges for
autonomous vehicles, especially in safety-critical situations. As a key component of artificial …

Reinforcement-learning in fronto-striatal circuits

B Averbeck, JP O'Doherty - Neuropsychopharmacology, 2022 - nature.com
We review the current state of knowledge on the computational and neural mechanisms of
reinforcement-learning with a particular focus on fronto-striatal circuits. We divide the …

[HTML][HTML] Instructor-learner brain coupling discriminates between instructional approaches and predicts learning

Y Pan, S Dikker, P Goldstein, Y Zhu, C Yang, Y Hu - NeuroImage, 2020 - Elsevier
The neural mechanisms that support naturalistic learning via effective pedagogical
approaches remain elusive. Here we used functional near-infrared spectroscopy to measure …

A model for learning based on the joint estimation of stochasticity and volatility

P Piray, ND Daw - Nature communications, 2021 - nature.com
Previous research has stressed the importance of uncertainty for controlling the speed of
learning, and how such control depends on the learner inferring the noise properties of the …

Specializations for reward-guided decision-making in the primate ventral prefrontal cortex

EA Murray, PH Rudebeck - Nature Reviews Neuroscience, 2018 - nature.com
The estimated values of choices, and therefore decision-making based on those values, are
influenced by both the chance that the chosen items or goods can be obtained (availability) …

Motivational neural circuits underlying reinforcement learning

BB Averbeck, VD Costa - Nature Neuroscience, 2017 - nature.com
Reinforcement learning (RL) is the behavioral process of learning the values of actions and
objects. Most models of RL assume that the dopaminergic prediction error signal drives …