We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Optimization and Control

Title: Fast Krasnosel'skii-Mann algorithm with a convergence rate of the fixed point iteration of $o\left(\frac{1}{k}\right)$

Abstract: The Krasnosel'skii-Mann (KM) algorithm is the most fundamental iterative scheme designed to find a fixed point of an averaged operator in the framework of a real Hilbert space, since it lies at the heart of various numerical algorithms for solving monotone inclusions and convex optimization problems. We enhance the Krasnosel'skii-Mann algorithm with Nesterov's momentum updates and show that the resulting numerical method exhibits a convergence rate for the fixed point residual of $o(1/k)$ while preserving the weak convergence of the iterates to a fixed point of the operator. Numerical experiments illustrate the superiority of the resulting so-called Fast KM algorithm over various fixed point iterative schemes, and also its oscillatory behavior, which is a specific of Nesterov's momentum optimization algorithms.
Subjects: Optimization and Control (math.OC); Numerical Analysis (math.NA)
MSC classes: 47J20, 47H05, 65K15, 65Y20
Cite as: arXiv:2206.09462 [math.OC]
  (or arXiv:2206.09462v2 [math.OC] for this version)

Submission history

From: Radu Ioan Bot [view email]
[v1] Sun, 19 Jun 2022 18:18:21 GMT (512kb,D)
[v2] Thu, 24 Aug 2023 20:15:22 GMT (1217kb,D)

Link back to: arXiv, form interface, contact.