We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Optimization and Control

Title: On the rate of convergence of the Difference-of-Convex Algorithm (DCA)

Abstract: In this paper, we study the convergence rate of the DCA (Difference-of-Convex Algorithm), also known as the convex-concave procedure, with two different termination criteria that are suitable for smooth and nonsmooth decompositions respectively. The DCA is a popular algorithm for difference-of-convex (DC) problems, and known to converge to a stationary point of the objective under some assumptions. We derive a worst-case convergence rate of $O(1/\sqrt{N})$ after $N$ iterations of the objective gradient norm for certain classes of DC problems, without assuming strong convexity in the DC decomposition, and give an example which shows the convergence rate is exact. We also provide a new convergence rate of $O(1/N)$ for the DCA with the second termination criterion. %In addition, we investigate the DCA with regularization. Moreover, we derive a new linear convergence rate result for the DCA under the assumption of the Polyak-\L ojasiewicz inequality. The novel aspect of our analysis is that it employs semidefinite programming performance estimation.
Subjects: Optimization and Control (math.OC)
Cite as: arXiv:2109.13566 [math.OC]
  (or arXiv:2109.13566v5 [math.OC] for this version)

Submission history

From: Moslem Zamani [view email]
[v1] Tue, 28 Sep 2021 08:57:53 GMT (48kb)
[v2] Thu, 24 Feb 2022 12:05:23 GMT (34kb)
[v3] Fri, 25 Feb 2022 08:00:19 GMT (34kb)
[v4] Fri, 17 Jun 2022 11:25:58 GMT (26kb)
[v5] Thu, 23 Feb 2023 13:56:09 GMT (35kb)

Link back to: arXiv, form interface, contact.