We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: Non-asymptotic convergence analysis for the Unadjusted Langevin Algorithm

Authors: Alain Durmus (LTCI), Eric Moulines (CMAP)
Abstract: Sampling distribution over high-dimensional state-space is a problem which has recently attracted a lot of research efforts; applications include Bayesian non-parametrics, Bayesian inverse problems and aggregation of estimators. All these problems boil down to sample a target distribution $\pi$ having a density w.r.t. the Lebesgue measure on $\mathbb{R}^d$, known up to a normalisation factor $x \mapsto \mathrm{e}^{-U(x)}/ \int\_{\mathbb{R}^d}\mathrm{e}^{ --U (y)} \mathrm{d}y$ where $U$ is continuously differentiable with Lipschitz gradient. In this paper, we study a sampling technique based on the Euler discretization of the Langevin stochastic differential equation. Contrary to the Metropolis Adjusted Langevin Algorithm (MALA), we do not apply a Metropolis-Hastings correction. We obtain for both constant and decreasing step sizes in the Euler discretization, non-asymptotic bounds for the convergence to the target distribution $\pi$ in total variation distance. A particular attention is paid on the dependence on the dimension of the state space, to demonstrate the applicability of this method in the high dimensional setting, at least when $U$ is convex. These bounds improve and extend the results of (Dalalyan 2014).
Subjects: Statistics Theory (math.ST); Computation (stat.CO); Methodology (stat.ME)
Cite as: arXiv:1507.05021 [math.ST]
  (or arXiv:1507.05021v2 [math.ST] for this version)

Submission history

From: Alain Durmus [view email]
[v1] Fri, 17 Jul 2015 16:23:23 GMT (753kb)
[v2] Mon, 7 Mar 2016 17:07:11 GMT (79kb)
[v3] Mon, 19 Dec 2016 14:27:42 GMT (71kb)

Link back to: arXiv, form interface, contact.