We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: The Connection Between Nesterov's Accelerated Methods and Halpern Fixed-Point Iterations

Abstract: We derive a direct connection between Nesterov's accelerated first-order algorithm and the Halpern fixed-point iteration scheme for approximating a solution of a co-coercive equation. We show that one method is equivalent to another via a simple transformation, leading to a simple convergence proof for Nesterov's accelerated scheme. Alternatively, we directly establish convergence rates of Nesterov's accelerated variant, and as a consequence, we obtain a new convergence rate of the Halpern fixed-point iteration. Next, we apply our results to different methods such as proximal-point, forwarb-backward splitting, and three-operator splitting methods for solving monotone inclusions, where our convergence guarantees are applicable. Since the forward scheme requires the co-coerciveness of the underlying operator, we derive new Nesterov's accelerated variants for both recent extra-anchored gradient and past-extra anchored gradient methods which can avoid the co-coerciveness assumption. For the extra-anchored gradient method, we consider two variants studied in [43] for the monotone case and in [21] for the co-monotone case. The latter covers the former as a special case and has a tighter convergence rate. For the past-extra anchored gradient method (an accelerated variant of the optimistic gradient method) [41], we obtain a new Nesterov's accelerated variant with two past-iterate correction terms that may help to develop new Nesterov's accelerated methods for minimax problems and their continuous views. We test our theoretical results on two numerical examples, where the actual convergence rates match well the theoretical rates up to a constant factor.
Comments: 33 pages, 2 figures
Subjects: Optimization and Control (math.OC)
Report number: UNC-STOR-03042022
Cite as: arXiv:2203.04869 [math.OC]
  (or arXiv:2203.04869v1 [math.OC] for this version)

Submission history

From: Quoc Tran-Dinh [view email]
[v1] Wed, 9 Mar 2022 16:45:10 GMT (107kb,D)

Link back to: arXiv, form interface, contact.