We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.PR

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Probability

Title: Weak Convergence of Approximate reflection coupling and its Application to Non-convex Optimization

Abstract: In this paper, we propose a weak approximation of the reflection coupling (RC) for stochastic differential equations (SDEs), and prove it converges weakly to the desired coupling. In contrast to the RC, the proposed approximate reflection coupling (ARC) need not take the hitting time of processes to the diagonal set into consideration and can be defined as the solution of some SDEs on the whole time interval. Therefore, ARC can work effectively against SDEs with different drift terms. As an application of ARC, an evaluation on the effectiveness of the stochastic gradient descent in a non-convex setting is also described. For the sample size $n$, the step size $\eta$, and the batch size $B$, we derive uniform evaluations on the time with orders $n^{-1}$, $\eta^{1/2}$, and $\sqrt{(n - B) / B (n - 1)}$, respectively.
Comments: 21 pages, a typo in the proof of Lemma 3.2 has been fixed
Subjects: Probability (math.PR); Machine Learning (stat.ML)
MSC classes: Primary 60J20, Secondary 60H10
Cite as: arXiv:2205.11970 [math.PR]
  (or arXiv:2205.11970v2 [math.PR] for this version)

Submission history

From: Keisuke Suzuki [view email]
[v1] Tue, 24 May 2022 11:08:13 GMT (22kb)
[v2] Sun, 5 Jun 2022 01:12:34 GMT (25kb)

Link back to: arXiv, form interface, contact.