Accelerating MCMC algorithms
Markov chain Monte Carlo algorithms are used to simulate from complex statistical
distributions by way of a local exploration of these distributions. This local feature avoids …
distributions by way of a local exploration of these distributions. This local feature avoids …
Geometric integrators and the Hamiltonian Monte Carlo method
N Bou-Rabee, JM Sanz-Serna - Acta Numerica, 2018 - cambridge.org
This paper surveys in detail the relations between numerical integration and the Hamiltonian
(or hybrid) Monte Carlo method (HMC). Since the computational cost of HMC mainly lies in …
(or hybrid) Monte Carlo method (HMC). Since the computational cost of HMC mainly lies in …
Couplings and quantitative contraction rates for Langevin dynamics
We introduce a new probabilistic approach to quantify convergence to equilibrium for
(kinetic) Langevin processes. In contrast to previous analytic approaches that focus on the …
(kinetic) Langevin processes. In contrast to previous analytic approaches that focus on the …
Coupling and convergence for Hamiltonian monte carlo
Based on a new coupling approach, we prove that the transition step of the Hamiltonian
Monte Carlo algorithm is contractive wrt a carefully designed Kantorovich (L ¹ Wasserstein) …
Monte Carlo algorithm is contractive wrt a carefully designed Kantorovich (L ¹ Wasserstein) …
On the geometric ergodicity of Hamiltonian Monte Carlo
Supplement to “On the geometric ergodicity of Hamiltonian Monte Carlo”. We provide
additional examples of π-irreducibility, with supporting plots, as well as elaborating on the …
additional examples of π-irreducibility, with supporting plots, as well as elaborating on the …
Mixing of Hamiltonian Monte Carlo on strongly log-concave distributions: Continuous dynamics
O Mangoubi, A Smith - The Annals of Applied Probability, 2021 - projecteuclid.org
We obtain several quantitative bounds on the mixing properties of an “ideal” Hamiltonian
Monte Carlo (HMC) Markov chain for a strongly log-concave target distribution π on R d. Our …
Monte Carlo (HMC) Markov chain for a strongly log-concave target distribution π on R d. Our …
Non-reversible lifts of reversible diffusion processes and relaxation times
We propose a new concept of lifts of reversible diffusion processes and show that various
well-known non-reversible Markov processes arising in applications are lifts in this sense of …
well-known non-reversible Markov processes arising in applications are lifts in this sense of …
The connections between Lyapunov functions for some optimization algorithms and differential equations
JM Sanz Serna, KC Zygalakis - SIAM Journal on Numerical Analysis, 2021 - SIAM
In this manuscript we study the properties of a family of a second-order differential equations
with damping, its discretizations, and their connections with accelerated optimization …
with damping, its discretizations, and their connections with accelerated optimization …
The Hastings algorithm at fifty
DB Dunson, JE Johndrow - Biometrika, 2020 - academic.oup.com
In a 1970 Biometrika paper, WK Hastings developed a broad class of Markov chain
algorithms for sampling from probability distributions that are difficult to sample from directly …
algorithms for sampling from probability distributions that are difficult to sample from directly …
On the convergence of hamiltonian monte carlo
A Durmus, E Moulines, E Saksman - arXiv preprint arXiv:1705.00166, 2017 - arxiv.org
This paper discusses the irreducibility and geometric ergodicity of the Hamiltonian Monte
Carlo (HMC) algorithm. We consider cases where the number of steps of the symplectic …
Carlo (HMC) algorithm. We consider cases where the number of steps of the symplectic …