Offline reinforcement learning: Tutorial, review, and perspectives on open problems

S Levine, A Kumar, G Tucker, J Fu - arXiv preprint arXiv:2005.01643, 2020 - arxiv.org
In this tutorial article, we aim to provide the reader with the conceptual tools needed to get
started on research on offline reinforcement learning algorithms: reinforcement learning …

A survey on causal inference

L Yao, Z Chu, S Li, Y Li, J Gao, A Zhang - ACM Transactions on …, 2021 - dl.acm.org
Causal inference is a critical research topic across many domains, such as statistics,
computer science, education, public policy, and economics, for decades. Nowadays …

Rt-1: Robotics transformer for real-world control at scale

A Brohan, N Brown, J Carbajal, Y Chebotar… - arXiv preprint arXiv …, 2022 - arxiv.org
By transferring knowledge from large, diverse, task-agnostic datasets, modern machine
learning models can solve specific downstream tasks either zero-shot or with small task …

Machine learning methods that economists should know about

S Athey, GW Imbens - Annual Review of Economics, 2019 - annualreviews.org
We discuss the relevance of the recent machine learning (ML) literature for economics and
econometrics. First we discuss the differences in goals, methods, and settings between the …

Quasi-oracle estimation of heterogeneous treatment effects

X Nie, S Wager - Biometrika, 2021 - academic.oup.com
Flexible estimation of heterogeneous treatment effects lies at the heart of many statistical
applications, such as personalized medicine and optimal resource allocation. In this article …

The impact of machine learning on economics

S Athey - The economics of artificial intelligence: An agenda, 2018 - degruyter.com
I believe that machine learning (ML) will have a dramatic impact on the field of economics
within a short time frame. Indeed, the impact of ML on economics is already well underway …

Introduction to multi-armed bandits

A Slivkins - Foundations and Trends® in Machine Learning, 2019 - nowpublishers.com
Multi-armed bandits a simple but very powerful framework for algorithms that make
decisions over time under uncertainty. An enormous body of work has accumulated over the …

The state of applied econometrics: Causality and policy evaluation

S Athey, GW Imbens - Journal of Economic perspectives, 2017 - aeaweb.org
In this paper, we discuss recent developments in econometrics that we view as important for
empirical researchers working on policy evaluation questions. We focus on three main …

Dualdice: Behavior-agnostic estimation of discounted stationary distribution corrections

O Nachum, Y Chow, B Dai, L Li - Advances in neural …, 2019 - proceedings.neurips.cc
In many real-world reinforcement learning applications, access to the environment is limited
to a fixed dataset, instead of direct (online) interaction with the environment. When using this …

Beyond prediction: Using big data for policy problems

S Athey - Science, 2017 - science.org
Machine-learning prediction methods have been extremely productive in applications
ranging from medicine to allocating fire and health inspectors in cities. However, there are a …