Robust reinforcement learning using offline data
The goal of robust reinforcement learning (RL) is to learn a policy that is robust against the
uncertainty in model parameters. Parameter uncertainty commonly occurs in many real …
uncertainty in model parameters. Parameter uncertainty commonly occurs in many real …
Policy gradient method for robust reinforcement learning
This paper develops the first policy gradient method with global optimality guarantee and
complexity analysis for robust reinforcement learning under model mismatch. Robust …
complexity analysis for robust reinforcement learning under model mismatch. Robust …
The curious price of distributional robustness in reinforcement learning with a generative model
This paper investigates model robustness in reinforcement learning (RL) via the framework
of distributionally robust Markov decision processes (RMDPs). Despite recent efforts, the …
of distributionally robust Markov decision processes (RMDPs). Despite recent efforts, the …
Distributionally robust model-based offline reinforcement learning with near-optimal sample complexity
This paper concerns the central issues of model robustness and sample efficiency in offline
reinforcement learning (RL), which aims to learn to perform decision making from history …
reinforcement learning (RL), which aims to learn to perform decision making from history …
Seeing is not believing: Robust reinforcement learning against spurious correlation
Robustness has been extensively studied in reinforcement learning (RL) to handle various
forms of uncertainty such as random perturbations, rare events, and malicious attacks. In this …
forms of uncertainty such as random perturbations, rare events, and malicious attacks. In this …
Toward theoretical understandings of robust markov decision processes: Sample complexity and asymptotics
Toward theoretical understandings of robust Markov decision processes: Sample
complexity and asymptotics Page 1 The Annals of Statistics 2022, Vol. 50, No. 6, 3223–3248 …
complexity and asymptotics Page 1 The Annals of Statistics 2022, Vol. 50, No. 6, 3223–3248 …
Twice regularized MDPs and the equivalence between robustness and regularization
Abstract Robust Markov decision processes (MDPs) aim to handle changing or partially
known system dynamics. To solve them, one typically resorts to robust optimization methods …
known system dynamics. To solve them, one typically resorts to robust optimization methods …
Fast bellman updates for wasserstein distributionally robust MDPs
Markov decision processes (MDPs) often suffer from the sensitivity issue under model
ambiguity. In recent years, robust MDPs have emerged as an effective framework to …
ambiguity. In recent years, robust MDPs have emerged as an effective framework to …
Policy gradient in robust mdps with global convergence guarantee
Abstract Robust Markov decision processes (RMDPs) provide a promising framework for
computing reliable policies in the face of model errors. Many successful reinforcement …
computing reliable policies in the face of model errors. Many successful reinforcement …
Robust reinforcement learning using least squares policy iteration with provable performance guarantees
KP Badrinath, D Kalathil - International Conference on …, 2021 - proceedings.mlr.press
This paper addresses the problem of model-free reinforcement learning for Robust Markov
Decision Process (RMDP) with large state spaces. The goal of the RMDPs framework is to …
Decision Process (RMDP) with large state spaces. The goal of the RMDPs framework is to …