We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: A Continuous-Time Perspective on Optimal Methods for Monotone Equation Problems

Abstract: We study \textit{rescaled gradient dynamical systems} in a Hilbert space $\mathcal{H}$, where implicit discretization in a finite-dimensional Euclidean space leads to high-order methods for solving monotone equations (MEs). Our framework can be interpreted as a natural generalization of celebrated dual extrapolation method from first order to high order via appeal to the regularization toolbox of optimization theory. In particular, we establish the global existence and uniqueness and analyze the convergence properties of solution trajectories. We also present discrete-time counterparts of our high-order continuous-time methods, and we show that the $p^{th}$-order method achieves an ergodic rate of $O(k^{-(p+1)/2})$ in terms of a restricted merit function and a pointwise rate of $O(k^{-p/2})$ in terms of a residue function. Under regularity conditions, the restarted version of $p^{th}$-order methods achieves local convergence with the order $p \geq 2$. Notably, our methods are \textit{optimal} since they have matched the lower bound established for solving the monotone equation problems.
Comments: 23 Pages; Fixing some confusing points in the proof and simplifying the main context
Subjects: Optimization and Control (math.OC); Computational Complexity (cs.CC); Data Structures and Algorithms (cs.DS)
Cite as: arXiv:2206.04770 [math.OC]
  (or arXiv:2206.04770v3 [math.OC] for this version)

Submission history

From: Tianyi Lin [view email]
[v1] Thu, 9 Jun 2022 21:16:11 GMT (34kb)
[v2] Sun, 24 Jul 2022 21:36:58 GMT (34kb)
[v3] Sun, 18 Dec 2022 03:59:13 GMT (22kb)

Link back to: arXiv, form interface, contact.