Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Underdamped Langevin MCMC: A non-asymptotic analysis
(Submitted on 12 Jul 2017 (v1), last revised 26 Jan 2018 (this version, v7))
Abstract: We study the underdamped Langevin diffusion when the log of the target distribution is smooth and strongly concave. We present a MCMC algorithm based on its discretization and show that it achieves $\varepsilon$ error (in 2-Wasserstein distance) in $\mathcal{O}(\sqrt{d}/\varepsilon)$ steps. This is a significant improvement over the best known rate for overdamped Langevin MCMC, which is $\mathcal{O}(d/\varepsilon^2)$ steps under the same smoothness/concavity assumptions.
The underdamped Langevin MCMC scheme can be viewed as a version of Hamiltonian Monte Carlo (HMC) which has been observed to outperform overdamped Langevin MCMC methods in a number of application areas. We provide quantitative rates that support this empirical wisdom.
Submission history
From: Niladri Chatterji [view email][v1] Wed, 12 Jul 2017 12:08:55 GMT (733kb)
[v2] Wed, 9 Aug 2017 04:23:36 GMT (733kb)
[v3] Thu, 2 Nov 2017 20:55:26 GMT (808kb)
[v4] Sat, 11 Nov 2017 20:06:25 GMT (124kb)
[v5] Mon, 1 Jan 2018 23:24:29 GMT (29kb)
[v6] Tue, 16 Jan 2018 19:28:32 GMT (29kb)
[v7] Fri, 26 Jan 2018 21:56:51 GMT (30kb)
Link back to: arXiv, form interface, contact.