Current browse context:
math.PR
Change to browse by:
References & Citations
Mathematics > Probability
Title: Stochastic Gradient Descent in Continuous Time: A Central Limit Theorem
(Submitted on 11 Oct 2017 (v1), last revised 17 Jun 2019 (this version, v4))
Abstract: Stochastic gradient descent in continuous time (SGDCT) provides a computationally efficient method for the statistical learning of continuous-time models, which are widely used in science, engineering, and finance. The SGDCT algorithm follows a (noisy) descent direction along a continuous stream of data. The parameter updates occur in continuous time and satisfy a stochastic differential equation. This paper analyzes the asymptotic convergence rate of the SGDCT algorithm by proving a central limit theorem (CLT) for strongly convex objective functions and, under slightly stronger conditions, for non-convex objective functions as well. An $L^{p}$ convergence rate is also proven for the algorithm in the strongly convex case. The mathematical analysis lies at the intersection of stochastic analysis and statistical learning.
Submission history
From: Konstantinos Spiliopoulos [view email][v1] Wed, 11 Oct 2017 19:41:36 GMT (29kb)
[v2] Thu, 2 Nov 2017 17:26:15 GMT (35kb)
[v3] Tue, 27 Nov 2018 18:42:25 GMT (38kb)
[v4] Mon, 17 Jun 2019 06:52:10 GMT (39kb)
Link back to: arXiv, form interface, contact.