Accelerating MCMC algorithms

CP Robert, V Elvira, N Tawn… - Wiley Interdisciplinary …, 2018 - Wiley Online Library
Markov chain Monte Carlo algorithms are used to simulate from complex statistical
distributions by way of a local exploration of these distributions. This local feature avoids …

Geometric integrators and the Hamiltonian Monte Carlo method

N Bou-Rabee, JM Sanz-Serna - Acta Numerica, 2018 - cambridge.org
This paper surveys in detail the relations between numerical integration and the Hamiltonian
(or hybrid) Monte Carlo method (HMC). Since the computational cost of HMC mainly lies in …

Couplings and quantitative contraction rates for Langevin dynamics

A Eberle, A Guillin, R Zimmer - 2019 - projecteuclid.org
We introduce a new probabilistic approach to quantify convergence to equilibrium for
(kinetic) Langevin processes. In contrast to previous analytic approaches that focus on the …

Coupling and convergence for Hamiltonian monte carlo

N Bou-Rabee, A Eberle, R Zimmer - The Annals of applied probability, 2020 - JSTOR
Based on a new coupling approach, we prove that the transition step of the Hamiltonian
Monte Carlo algorithm is contractive wrt a carefully designed Kantorovich (L ¹ Wasserstein) …

On the geometric ergodicity of Hamiltonian Monte Carlo

S Livingstone, M Betancourt, S Byrne, M Girolami - 2019 - projecteuclid.org
Supplement to “On the geometric ergodicity of Hamiltonian Monte Carlo”. We provide
additional examples of π-irreducibility, with supporting plots, as well as elaborating on the …

Mixing of Hamiltonian Monte Carlo on strongly log-concave distributions: Continuous dynamics

O Mangoubi, A Smith - The Annals of Applied Probability, 2021 - projecteuclid.org
We obtain several quantitative bounds on the mixing properties of an “ideal” Hamiltonian
Monte Carlo (HMC) Markov chain for a strongly log-concave target distribution π on R d. Our …

Non-reversible lifts of reversible diffusion processes and relaxation times

A Eberle, F Lörler - Probability Theory and Related Fields, 2024 - Springer
We propose a new concept of lifts of reversible diffusion processes and show that various
well-known non-reversible Markov processes arising in applications are lifts in this sense of …

The connections between Lyapunov functions for some optimization algorithms and differential equations

JM Sanz Serna, KC Zygalakis - SIAM Journal on Numerical Analysis, 2021 - SIAM
In this manuscript we study the properties of a family of a second-order differential equations
with damping, its discretizations, and their connections with accelerated optimization …

The Hastings algorithm at fifty

DB Dunson, JE Johndrow - Biometrika, 2020 - academic.oup.com
In a 1970 Biometrika paper, WK Hastings developed a broad class of Markov chain
algorithms for sampling from probability distributions that are difficult to sample from directly …

On the convergence of hamiltonian monte carlo

A Durmus, E Moulines, E Saksman - arXiv preprint arXiv:1705.00166, 2017 - arxiv.org
This paper discusses the irreducibility and geometric ergodicity of the Hamiltonian Monte
Carlo (HMC) algorithm. We consider cases where the number of steps of the symplectic …