We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Optimization and Control

Title: Accelerated forward-backward method with fast convergence rate for nonsmooth convex optimization beyond differentiability

Authors: Wei Bian, Fan Wu
Abstract: We propose an accelerated forward-backward method with fast convergence rate for finding a minimizer of a decomposable nonsmooth convex function over a closed convex set, and name it smoothing accelerated proximal gradient (SAPG) algorithm. The proposed algorithm combines the smoothing method with the proximal gradient algorithm with extrapolation $\frac{k-1}{k+\alpha-1}$ and $\alpha>3$. The updating rule of smoothing parameter $\mu_k$ is a smart scheme and guarantees the global convergence rate of $o(\ln^{\sigma}k/k)$ with $\sigma\in(\frac{1}{2},1]$ on the objective function values. Moreover, we prove that the sequence is convergent to an optimal solution of the problem. Furthermore, we introduce an error term in the SAPG algorithm to get the inexact smoothing accelerated proximal gradient algorithm. And we obtain the same convergence results as the SAPG algorithm under the summability condition on the errors. Finally, numerical experiments show the effectiveness and efficiency of the proposed algorithm.
Subjects: Optimization and Control (math.OC)
Cite as: arXiv:2110.01454 [math.OC]
  (or arXiv:2110.01454v1 [math.OC] for this version)

Submission history

From: Fan Wu [view email]
[v1] Mon, 4 Oct 2021 13:38:53 GMT (100kb,D)

Link back to: arXiv, form interface, contact.