We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Optimization and Control

Title: On fast convergence rates for generalized conditional gradient methods with backtracking stepsize

Abstract: A generalized conditional gradient method for minimizing the sum of two convex functions, one of them differentiable, is presented. This iterative method relies on two main ingredients: First, the minimization of a partially linearized objective functional to compute a descent direction and, second, a stepsize choice based on an Armijo-like condition to ensure sufficient descent in every iteration. We provide several convergence results. Under mild assumptions, the method generates sequences of iterates which converge, on subsequences, towards minimizers. Moreover a sublinear rate of convergence for the objective functional values is derived. Second, we show that the method enjoys improved rates of convergence if the partially linearized problem fulfills certain growth estimates. Most notably these results do not require strong convexity of the objective functional. Numerical tests on a variety of challenging PDE-constrained optimization problems confirm the practical efficiency of the proposed algorithm.
Comments: 28 pages, 17 figures
Subjects: Optimization and Control (math.OC)
Cite as: arXiv:2109.15217 [math.OC]
  (or arXiv:2109.15217v1 [math.OC] for this version)

Submission history

From: Daniel Walter [view email]
[v1] Thu, 30 Sep 2021 15:39:51 GMT (439kb,D)

Link back to: arXiv, form interface, contact.