Markov chain Monte Carlo in practice
Markov chain Monte Carlo (MCMC) is an essential set of tools for estimating features of
probability distributions commonly encountered in modern applications. For MCMC …
probability distributions commonly encountered in modern applications. For MCMC …
Log-concave sampling: Metropolis-Hastings algorithms are fast
We study the problem of sampling from a strongly log-concave density supported on
$\mathbb {R}^ d $, and prove a non-asymptotic upper bound on the mixing time of the …
$\mathbb {R}^ d $, and prove a non-asymptotic upper bound on the mixing time of the …
Sampling can be faster than optimization
Optimization algorithms and Monte Carlo sampling algorithms have provided the
computational foundations for the rapid growth in applications of statistical machine learning …
computational foundations for the rapid growth in applications of statistical machine learning …
On sampling from a log-concave density using kinetic Langevin diffusions
AS Dalalyan, L Riou-Durand - 2020 - projecteuclid.org
Langevin diffusion processes and their discretizations are often used for sampling from a
target density. The most convenient framework for assessing the quality of such a sampling …
target density. The most convenient framework for assessing the quality of such a sampling …
Sharp convergence rates for Langevin dynamics in the nonconvex setting
We study the problem of sampling from a distribution $ p^*(x)\propto\exp\left (-U (x)\right) $,
where the function $ U $ is $ L $-smooth everywhere and $ m $-strongly convex outside a …
where the function $ U $ is $ L $-smooth everywhere and $ m $-strongly convex outside a …
Is there an analog of Nesterov acceleration for gradient-based MCMC?
We formulate gradient-based Markov chain Monte Carlo (MCMC) sampling as optimization
on the space of probability measures, with Kullback–Leibler (KL) divergence as the …
on the space of probability measures, with Kullback–Leibler (KL) divergence as the …
Unbiased Markov chain Monte Carlo methods with couplings
PE Jacob, J O'Leary, YF Atchadé - Journal of the Royal …, 2020 - academic.oup.com
Summary Markov chain Monte Carlo (MCMC) methods provide consistent approximations of
integrals as the number of iterations goes to∞. MCMC estimators are generally biased after …
integrals as the number of iterations goes to∞. MCMC estimators are generally biased after …
Fast mixing of Metropolized Hamiltonian Monte Carlo: Benefits of multi-step gradients
Hamiltonian Monte Carlo (HMC) is a state-of-the-art Markov chain Monte Carlo sampling
algorithm for drawing samples from smooth probability densities over continuous spaces …
algorithm for drawing samples from smooth probability densities over continuous spaces …
Mixing of Hamiltonian Monte Carlo on strongly log-concave distributions: Continuous dynamics
O Mangoubi, A Smith - The Annals of Applied Probability, 2021 - projecteuclid.org
We obtain several quantitative bounds on the mixing properties of an “ideal” Hamiltonian
Monte Carlo (HMC) Markov chain for a strongly log-concave target distribution π on R d. Our …
Monte Carlo (HMC) Markov chain for a strongly log-concave target distribution π on R d. Our …
Non-reversible lifts of reversible diffusion processes and relaxation times
We propose a new concept of lifts of reversible diffusion processes and show that various
well-known non-reversible Markov processes arising in applications are lifts in this sense of …
well-known non-reversible Markov processes arising in applications are lifts in this sense of …