References & Citations
Mathematics > Numerical Analysis
Title: Essential convergence rate of ordinary differential equations appearing in optimization
(Submitted on 6 Jun 2022 (v1), last revised 14 Jul 2022 (this version, v2))
Abstract: Some continuous optimization methods can be connected to ordinary differential equations (ODEs) by taking continuous limits, and their convergence rates can be explained by the ODEs. However, since such ODEs can achieve any convergence rate by time scaling, the correspondence is not as straightforward as usually expected, and deriving new methods through ODEs is not quite direct. In this letter, we pay attention to stability restriction in discretizing ODEs and show that acceleration by time scaling basically implies deceleration in discretization; they balance out so that we can define an attainable unique convergence rate which we call an "essential convergence rate".
Submission history
From: Kansei Ushiyama [view email][v1] Mon, 6 Jun 2022 13:13:49 GMT (10kb)
[v2] Thu, 14 Jul 2022 08:55:10 GMT (11kb)
Link back to: arXiv, form interface, contact.