References & Citations
Mathematics > Optimization and Control
Title: Linearly-Convergent FISTA Variant for Composite Optimization with Duality
(Submitted on 17 Jul 2021 (v1), last revised 28 Jul 2023 (this version, v2))
Abstract: Many large-scale optimization problems can be expressed as composite optimization models. Accelerated first-order methods such as the fast iterative shrinkage-thresholding algorithm (FISTA) have proven effective for numerous large composite models. In this paper, we present a new variation of FISTA, to be called C-FISTA, which obtains global linear convergence for a broader class of composite models than many of the latest FISTA variants. We demonstrate the versatility and effectiveness of C-FISTA by showing C-FISTA outperforms current first-order solvers on both group Lasso and group logistic regression models. Furthermore, we utilize Fenchel duality to prove C-FISTA provides global linear convergence for a large class of convex models without the loss of global linear convergence.
Submission history
From: Casey Garner [view email][v1] Sat, 17 Jul 2021 16:54:48 GMT (402kb,D)
[v2] Fri, 28 Jul 2023 18:23:34 GMT (1004kb,D)
Link back to: arXiv, form interface, contact.