[HTML][HTML] Human decision making balances reward maximization and policy compression

L Lai, SJ Gershman - PLOS Computational Biology, 2024 - journals.plos.org
Policy compression is a computational framework that describes how capacity-limited
agents trade reward for simpler action policies to reduce cognitive cost. In this study, we …

Mechanisms of adjustments to different types of uncertainty in the reward environment across mice and monkeys

JH Woo, CG Aguirre, BA Bari, KI Tsutsui… - Cognitive, Affective, & …, 2023 - Springer
Despite being unpredictable and uncertain, reward environments often exhibit certain
regularities, and animals navigating these environments try to detect and utilize such …

[HTML][HTML] Bayesian reinforcement learning with limited cognitive load

D Arumugam, MK Ho, ND Goodman, B Van Roy - Open Mind, 2024 - direct.mit.edu
All biological and artificial agents must act given limits on their ability to acquire and process
information. As such, a general theory of adaptive behavior should be able to account for the …

On Rate-Distortion Theory in Capacity-Limited Cognition & Reinforcement Learning

D Arumugam, MK Ho, ND Goodman… - arXiv preprint arXiv …, 2022 - arxiv.org
Throughout the cognitive-science literature, there is widespread agreement that decision-
making agents operating in the real world do so under limited information-processing …

Resource-rational psychopathology.

BA Bari, SJ Gershman - Behavioral Neuroscience, 2024 - psycnet.apa.org
Psychopathology is vast and diverse. Across distinct disease states, individuals exhibit
symptoms that appear counter to the standard view of rationality (expected utility …

[HTML][HTML] Active reinforcement learning versus action bias and hysteresis: control with a mixture of experts and nonexperts

JT Colas, JP O'Doherty, ST Grafton - PLOS Computational Biology, 2024 - journals.plos.org
Active reinforcement learning enables dynamic prediction and control, where one should not
only maximize rewards but also minimize costs such as of inference, decisions, actions, and …

Satisficing Exploration for Deep Reinforcement Learning

D Arumugam, S Kumar, R Gummadi… - arXiv preprint arXiv …, 2024 - arxiv.org
A default assumption in the design of reinforcement-learning algorithms is that a decision-
making agent always explores to learn optimal behavior. In sufficiently complex …

Computationally-informed insights into anhedonia and treatment by κ-opioid receptor antagonism

BA Bari, AD Krystal, DA Pizzagalli, SJ Gershman - medRxiv, 2024 - medrxiv.org
Anhedonia, the loss of pleasure, is prevalent and impairing. Parsing its computational basis
promises to explain its transdiagnostic character. We argue that one manifestation of …

[HTML][HTML] The role of rat prelimbic cortex in decision making

JA Palmer, SR White, KC Lopez, M Laubach - bioRxiv, 2024 - ncbi.nlm.nih.gov
The frontal cortex plays a critical role in decision-making. One specific frontal area, the
anterior cingulate cortex, has been identified as crucial for setting a threshold for how much …

[PDF][PDF] Pavlovian bias instigates suboptimal choices

L Degni, C Danti, G Finotti, S Garofalo, G di Pellegrino - 2024 - osf.io
In daily life, decisions are often biased by Pavlovian (eg, reward-associated) cues present in
the environment. Here, we propose that Pavlovian bias can instigate suboptimal choices …