We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: A Unified Convergence Rate Analysis of The Accelerated Smoothed Gap Reduction Algorithm

Abstract: In this paper, we develop a unified convergence analysis framework for the Accelerated Smoothed GAp ReDuction algorithm (ASGARD) introduced in [20, Tran-Dinh et al, 2015] Unlike[20], the new analysis covers three settings in a single algorithm: general convexity, strong convexity, and strong convexity and smoothness. Moreover, we establish the convergence guarantees on three criteria: (i) gap function, (ii) primal objective residual, and (iii) dual objective residual. Our convergence rates are optimal (up to a constant factor) in all cases. While the convergence rate on the primal objective residual for the general convex case has been established in [20], we prove additional convergence rates on the gap function and the dual objective residual. The analysis for the last two cases is completely new. Our results provide a complete picture on the convergence guarantees of ASGARD. Finally, we present four different numerical experiments on a representative optimization model to verify our algorithm and compare it with Nesterov's smoothing technique.
Comments: 23 pages and 2 figures
Subjects: Optimization and Control (math.OC)
MSC classes: 90C25, 90C06, 90-08
Report number: STOR-UNC-April 2021
Cite as: arXiv:2104.01314 [math.OC]
  (or arXiv:2104.01314v2 [math.OC] for this version)

Submission history

From: Quoc Tran-Dinh [view email]
[v1] Sat, 3 Apr 2021 04:52:37 GMT (43kb)
[v2] Tue, 15 Jun 2021 04:01:55 GMT (272kb)

Link back to: arXiv, form interface, contact.