We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.NA

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Numerical Analysis

Title: Multi Level Monte Carlo methods for a class of ergodic stochastic differential equations

Abstract: We develop a framework that allows the use of the multi-level Monte Carlo (MLMC) methodology (Giles 2015) to calculate expectations with respect to the invariant measures of ergodic SDEs. In that context, we study the (over-damped) Langevin equations with strongly convex potential. We show that, when appropriate contracting couplings for the numerical integrators are available, one can obtain a time-uniform estimates of the MLMC variance in stark contrast to the majority of the results in the MLMC literature. As a consequence, one can approximate expectations with respect to the invariant measure in an unbiased way without the need of a Metropolis- Hastings step. In addition, a root mean square error of $\mathcal{O}(\epsilon)$ is achieved with $\mathcal{O}(\epsilon^{-2})$ complexity on par with Markov Chain Monte Carlo (MCMC) methods, which however can be computationally intensive when applied to large data sets. Finally, we present a multilevel version of the recently introduced Stochastic Gradient Langevin (SGLD) method (Welling and Teh, 2011) built for large datasets applications. We show that this is the first stochastic gradient MCMC method with complexity $\mathcal{O}(\epsilon^{-2}|\log {\epsilon}|^{3})$, which is asymptotically an order $\epsilon$ lower than the $ \mathcal{O}(\epsilon^{-3})$ complexity of all stochastic gradient MCMC methods that are currently available. Numerical experiments confirm our theoretical findings.
Comments: 30 pages, 6 figures
Subjects: Numerical Analysis (math.NA); Methodology (stat.ME); Machine Learning (stat.ML)
Cite as: arXiv:1605.01384 [math.NA]
  (or arXiv:1605.01384v1 [math.NA] for this version)

Submission history

From: Konstantinos Zygalakis [view email]
[v1] Wed, 4 May 2016 19:12:13 GMT (982kb,D)
[v2] Sun, 31 Jul 2016 08:57:39 GMT (993kb,D)
[v3] Tue, 19 Feb 2019 11:07:26 GMT (1028kb,D)
[v4] Mon, 12 Aug 2019 14:07:59 GMT (1345kb,D)

Link back to: arXiv, form interface, contact.