Mental effort is an elementary notion in our folk psychology and a familiar fixture in everyday
introspective experience. However, as an object of scientific study, mental effort has …

Human reasoning is often conceived as an interplay between a more intuitive and deliberate
thought process. In the last 50 years, influential fast-and-slow dual-process models that …

Distinct model-free and model-based learning processes are thought to drive both typical
and dysfunctional behaviours. Data from two-stage decision tasks have seemingly shown …

Dopamine contributes to cognitive control through well-established effects in both the
striatum and cortex. Although earlier work suggests that dopamine affects cognitive control …

Computer scientists have long recognized that naive implementations of algorithms often
result in a paralyzing degree of redundant computation. More sophisticated implementations …

It is now commonly accepted that instrumental actions can reflect goal-directed control; ie,
they can show sensitivity to changes in the relationship to and the value of their …

We present an integrated view of interval timing and reinforcement learning (RL) in the
brain. The computational goal of RL is to maximize future rewards, and this depends …

When humans and other animals make repeated choices, they tend to repeat previously
chosen actions independently of their reward history. This paper locates the origin of …

Social learning is complex, but people often seem to navigate social environments with
ease. This ability creates a puzzle for traditional accounts of reinforcement learning (RL) that …

A standard assumption in neuroscience is that low-effort model-free learning is automatic
and continuously used, whereas more complex model-based strategies are only used when …