Current browse context:
stat.ML
Change to browse by:
References & Citations
Mathematics > Numerical Analysis
Title: Multilevel Monte Carlo methods for the approximation of invariant measures of stochastic differential equations
(Submitted on 4 May 2016 (v1), last revised 12 Aug 2019 (this version, v4))
Abstract: We develop a framework that allows the use of the multi-level Monte Carlo (MLMC) methodology (Giles2015) to calculate expectations with respect to the invariant measure of an ergodic SDE. In that context, we study the (over-damped) Langevin equations with a strongly concave potential. We show that, when appropriate contracting couplings for the numerical integrators are available, one can obtain a uniform in time estimate of the MLMC variance in contrast to the majority of the results in the MLMC literature. As a consequence, a root mean square error of $\mathcal{O}(\varepsilon)$ is achieved with $\mathcal{O}(\varepsilon^{-2})$ complexity on par with Markov Chain Monte Carlo (MCMC) methods, which however can be computationally intensive when applied to large data sets. Finally, we present a multi-level version of the recently introduced Stochastic Gradient Langevin Dynamics (SGLD) method (Welling and Teh, 2011) built for large datasets applications. We show that this is the first stochastic gradient MCMC method with complexity $\mathcal{O}(\varepsilon^{-2}|\log {\varepsilon}|^{3})$, in contrast to the complexity $\mathcal{O}(\varepsilon^{-3})$ of currently available methods. Numerical experiments confirm our theoretical findings.
Submission history
From: Konstantinos Zygalakis [view email][v1] Wed, 4 May 2016 19:12:13 GMT (982kb,D)
[v2] Sun, 31 Jul 2016 08:57:39 GMT (993kb,D)
[v3] Tue, 19 Feb 2019 11:07:26 GMT (1028kb,D)
[v4] Mon, 12 Aug 2019 14:07:59 GMT (1345kb,D)
Link back to: arXiv, form interface, contact.