A review of off-policy evaluation in reinforcement learning

M Uehara, C Shi, N Kallus - arXiv preprint arXiv:2212.06355, 2022 - arxiv.org
Reinforcement learning (RL) is one of the most vibrant research frontiers in machine
learning and has been recently applied to solve a number of challenging problems. In this …

[HTML][HTML] Causal structure learning: A combinatorial perspective

C Squires, C Uhler - Foundations of Computational Mathematics, 2023 - Springer
In this review, we discuss approaches for learning causal structure from data, also called
causal discovery. In particular, we focus on approaches for learning directed acyclic graphs …

On measuring causal contributions via do-interventions

Y Jung, S Kasiviswanathan, J Tian… - International …, 2022 - proceedings.mlr.press
Causal contributions measure the strengths of different causes to a target quantity.
Understanding causal contributions is important in empirical sciences and data-driven …

Differentiable causal discovery under unmeasured confounding

R Bhattacharya, T Nagarajan… - International …, 2021 - proceedings.mlr.press
The data drawn from biological, economic, and social systems are often confounded due to
the presence of unmeasured variables. Prior work in causal discovery has focused on …

Estimating identifiable causal effects through double machine learning

Y Jung, J Tian, E Bareinboim - Proceedings of the AAAI Conference on …, 2021 - ojs.aaai.org
Identifying causal effects from observational data is a pervasive challenge found throughout
the empirical sciences. Very general methods have been developed to decide the …

Python package for causal discovery based on LiNGAM

T Ikeuchi, M Ide, Y Zeng, TN Maeda… - Journal of Machine …, 2023 - jmlr.org
Causal discovery is a methodology for learning causal graphs from data, and LiNGAM is a
well-known model for causal discovery. This paper describes an open-source Python …

Quantum inflation: A general approach to quantum causal compatibility

E Wolfe, A Pozas-Kerstjens, M Grinberg, D Rosset… - Physical Review X, 2021 - APS
Causality is a seminal concept in science: Any research discipline, from sociology and
medicine to physics and chemistry, aims at understanding the causes that could explain the …

Data-driven causal effect estimation based on graphical causal modelling: A survey

D Cheng, J Li, L Liu, J Liu, TD Le - ACM Computing Surveys, 2024 - dl.acm.org
In many fields of scientific research and real-world applications, unbiased estimation of
causal effects from non-experimental data is crucial for understanding the mechanism …

Learning causal effects via weighted empirical risk minimization

Y Jung, J Tian, E Bareinboim - Advances in neural …, 2020 - proceedings.neurips.cc
Learning causal effects from data is a fundamental problem across the sciences.
Determining the identifiability of a target effect from a combination of the observational …

Nested Markov properties for acyclic directed mixed graphs

TS Richardson, RJ Evans, JM Robins… - The Annals of …, 2023 - projecteuclid.org
Nested Markov properties for acyclic directed mixed graphs Page 1 The Annals of Statistics
2023, Vol. 51, No. 1, 334–361 https://doi.org/10.1214/22-AOS2253 © Institute of …