Recent developments in machine learning methods for stochastic control and games

R Hu, M Lauriere - arXiv preprint arXiv:2303.10257, 2023 - arxiv.org
Stochastic optimal control and games have a wide range of applications, from finance and
economics to social sciences, robotics, and energy management. Many real-world …

Neural networks-based algorithms for stochastic control and PDEs in finance

M Germain, H Pham, X Warin - arXiv preprint arXiv:2101.08068, 2021 - cambridge.org
This chapter presents machine learning techniques and deep reinforcement learning-based
algorithms for the efficient resolution of nonlinear partial differential equations and dynamic …

Generalization in mean field games by learning master policies

S Perrin, M Laurière, J Pérolat, R Élie, M Geist… - Proceedings of the …, 2022 - ojs.aaai.org
Abstract Mean Field Games (MFGs) can potentially scale multi-agent systems to extremely
large populations of agents. Yet, most of the literature assumes a single initial distribution for …

Mean-field neural networks: learning mappings on Wasserstein space

H Pham, X Warin - Neural Networks, 2023 - Elsevier
We study the machine learning task for models with operators mapping between the
Wasserstein space of probability measures and a space of functions, like eg in mean-field …

Actor-critic learning for mean-field control in continuous time

N Frikha, M Germain, M Laurière, H Pham… - arXiv preprint arXiv …, 2023 - arxiv.org
We study policy gradient for mean-field control in continuous time in a reinforcement
learning setting. By considering randomised policies with entropy regularisation, we derive a …

Universal approximation of symmetric and anti-symmetric functions

J Han, Y Li, L Lin, J Lu, J Zhang, L Zhang - arXiv preprint arXiv …, 2019 - arxiv.org
We consider universal approximations of symmetric and anti-symmetric functions, which are
important for applications in quantum physics, as well as other scientific and engineering …

Neural optimal stopping boundary

AM Reppen, HM Soner, V Tissot-Daguette - arXiv preprint arXiv …, 2022 - arxiv.org
A method based on deep artificial neural networks and empirical risk minimization is
developed to calculate the boundary separating the stopping and continuation regions in …

Rate of convergence for particle approximation of PDEs in Wasserstein space

M Germain, H Pham, X Warin - Journal of Applied Probability, 2022 - cambridge.org
We prove a rate of convergence for the N-particle approximation of a second-order partial
differential equation in the space of probability measures, such as the master equation or …

A fast iterative PDE-based algorithm for feedback controls of nonsmooth mean-field control problems

C Reisinger, W Stockinger, Y Zhang - SIAM Journal on Scientific Computing, 2024 - SIAM
We propose a PDE-based accelerated gradient algorithm for optimal feedback controls of
McKean–Vlasov dynamics that involve mean-field interactions both in the state and action …

Deep backward and galerkin methods for the finite state master equation

A Cohen, M Laurière, E Zell - arXiv preprint arXiv:2403.04975, 2024 - arxiv.org
This paper proposes and analyzes two neural network methods to solve the master equation
for finite-state mean field games (MFGs). Solving MFGs provides approximate Nash …