[PDF][PDF] Adaptive learning systems and interference in causal inference
Adaptive learning systems can be susceptible to between-subject cross-condition
interference by design. This interference has important implications for the implementation
and evaluation of A/B tests in such systems, as it obstructs causal inference and hurts
external validity. We illustrate the problem in an Elo based adaptive learning system, discuss
sources and degrees of interference, and provide solutions, using an example in the study of
dropout.
interference by design. This interference has important implications for the implementation
and evaluation of A/B tests in such systems, as it obstructs causal inference and hurts
external validity. We illustrate the problem in an Elo based adaptive learning system, discuss
sources and degrees of interference, and provide solutions, using an example in the study of
dropout.
Abstract
Adaptive learning systems can be susceptible to between-subject cross-condition interference by design. This interference has important implications for the implementation and evaluation of A/B tests in such systems, as it obstructs causal inference and hurts external validity. We illustrate the problem in an Elo based adaptive learning system, discuss sources and degrees of interference, and provide solutions, using an example in the study of dropout.
psyarxiv.com
以上显示的是最相近的搜索结果。 查看全部搜索结果