Balancing exploration and exploitation with information and randomization
Explore-exploit decisions require us to trade off the benefits of exploring unknown options to
learn more about them, with exploiting known options, for immediate reward. Such decisions …
learn more about them, with exploiting known options, for immediate reward. Such decisions …
The science of science: From the perspective of complex systems
The science of science (SOS) is a rapidly developing field which aims to understand,
quantify and predict scientific research and the resulting outcomes. The problem is …
quantify and predict scientific research and the resulting outcomes. The problem is …
Adolescent risk-taking in the context of exploration and social influence
S Ciranka, W van den Bos - Developmental Review, 2021 - Elsevier
Adolescents are often described as a strange and different species that behaves like no
other age group, typical behaviours being excessive risk-taking and sensitivity to peer …
other age group, typical behaviours being excessive risk-taking and sensitivity to peer …
Deconstructing the human algorithms for exploration
SJ Gershman - Cognition, 2018 - Elsevier
The dilemma between information gathering (exploration) and reward seeking (exploitation)
is a fundamental problem for reinforcement learning agents. How humans resolve this …
is a fundamental problem for reinforcement learning agents. How humans resolve this …
The algorithmic architecture of exploration in the human brain
E Schulz, SJ Gershman - Current opinion in neurobiology, 2019 - Elsevier
Highlights•Humans use uncertainty-based algorithms to balance exploration and
exploitation.•Humans utilize structure in the state space to make exploration more …
exploitation.•Humans utilize structure in the state space to make exploration more …
A guide to area‐restricted search: a foundational foraging behaviour
Area‐restricted search is the capacity to change search effort adaptively in response to
resource encounters or expectations, from directional exploration (global, extensive search) …
resource encounters or expectations, from directional exploration (global, extensive search) …
Acetylcholine and noradrenaline enhance foraging optimality in humans
Foraging theory prescribes when optimal foragers should leave the current option for more
rewarding alternatives. Actual foragers often exploit options longer than prescribed by the …
rewarding alternatives. Actual foragers often exploit options longer than prescribed by the …
Children are more exploratory and learn more than adults in an approach-avoid task
Intuitively, children appear to be more exploratory than adults, and this exploration seems to
help children learn,. However, there have been few clear tests of these ideas. We test …
help children learn,. However, there have been few clear tests of these ideas. We test …
Time pressure changes how people explore and respond to uncertainty
How does time pressure influence exploration and decision-making? We investigated this
question with several four-armed bandit tasks manipulating (within subjects) expected …
question with several four-armed bandit tasks manipulating (within subjects) expected …
Social evaluation: Comparing models across interpersonal, intragroup, intergroup, several-group, and many-group contexts
This chapter compares five models that analyze social evaluation from the micro,
interpersonal to macro, many-group level: the Dual Perspective Model (DPM), Behavioral …
interpersonal to macro, many-group level: the Dual Perspective Model (DPM), Behavioral …