Markov chain Monte Carlo in practice

GL Jones, Q Qin - Annual Review of Statistics and Its Application, 2022 - annualreviews.org
Markov chain Monte Carlo (MCMC) is an essential set of tools for estimating features of
probability distributions commonly encountered in modern applications. For MCMC …

Log-concave sampling: Metropolis-Hastings algorithms are fast

R Dwivedi, Y Chen, MJ Wainwright, B Yu - Journal of Machine Learning …, 2019 - jmlr.org
We study the problem of sampling from a strongly log-concave density supported on
$\mathbb {R}^ d $, and prove a non-asymptotic upper bound on the mixing time of the …

Sampling can be faster than optimization

YA Ma, Y Chen, C Jin… - Proceedings of the …, 2019 - National Acad Sciences
Optimization algorithms and Monte Carlo sampling algorithms have provided the
computational foundations for the rapid growth in applications of statistical machine learning …

On sampling from a log-concave density using kinetic Langevin diffusions

AS Dalalyan, L Riou-Durand - 2020 - projecteuclid.org
Langevin diffusion processes and their discretizations are often used for sampling from a
target density. The most convenient framework for assessing the quality of such a sampling …

Sharp convergence rates for Langevin dynamics in the nonconvex setting

X Cheng, NS Chatterji, Y Abbasi-Yadkori… - arXiv preprint arXiv …, 2018 - arxiv.org
We study the problem of sampling from a distribution $ p^*(x)\propto\exp\left (-U (x)\right) $,
where the function $ U $ is $ L $-smooth everywhere and $ m $-strongly convex outside a …

Is there an analog of Nesterov acceleration for gradient-based MCMC?

YA Ma, NS Chatterji, X Cheng, N Flammarion… - 2021 - projecteuclid.org
We formulate gradient-based Markov chain Monte Carlo (MCMC) sampling as optimization
on the space of probability measures, with Kullback–Leibler (KL) divergence as the …

Unbiased Markov chain Monte Carlo methods with couplings

PE Jacob, J O'Leary, YF Atchadé - Journal of the Royal …, 2020 - academic.oup.com
Summary Markov chain Monte Carlo (MCMC) methods provide consistent approximations of
integrals as the number of iterations goes to∞. MCMC estimators are generally biased after …

Fast mixing of Metropolized Hamiltonian Monte Carlo: Benefits of multi-step gradients

Y Chen, R Dwivedi, MJ Wainwright, B Yu - Journal of Machine Learning …, 2020 - jmlr.org
Hamiltonian Monte Carlo (HMC) is a state-of-the-art Markov chain Monte Carlo sampling
algorithm for drawing samples from smooth probability densities over continuous spaces …

Mixing of Hamiltonian Monte Carlo on strongly log-concave distributions: Continuous dynamics

O Mangoubi, A Smith - The Annals of Applied Probability, 2021 - projecteuclid.org
We obtain several quantitative bounds on the mixing properties of an “ideal” Hamiltonian
Monte Carlo (HMC) Markov chain for a strongly log-concave target distribution π on R d. Our …

Non-reversible lifts of reversible diffusion processes and relaxation times

A Eberle, F Lörler - Probability Theory and Related Fields, 2024 - Springer
We propose a new concept of lifts of reversible diffusion processes and show that various
well-known non-reversible Markov processes arising in applications are lifts in this sense of …