Current browse context:
math.OC
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Geometric descent method for convex composite minimization
(Submitted on 29 Dec 2016 (v1), last revised 30 May 2017 (this version, v4))
Abstract: In this paper, we extend the geometric descent method recently proposed by Bubeck, Lee and Singh to tackle nonsmooth and strongly convex composite problems. We prove that our proposed algorithm, dubbed geometric proximal gradient method (GeoPG), converges with a linear rate $(1-1/\sqrt{\kappa})$ and thus achieves the optimal rate among first-order methods, where $\kappa$ is the condition number of the problem. Numerical results on linear regression and logistic regression with elastic net regularization show that GeoPG compares favorably with Nesterov's accelerated proximal gradient method, especially when the problem is ill-conditioned.
Submission history
From: Shiqian Ma [view email][v1] Thu, 29 Dec 2016 04:25:28 GMT (18kb)
[v2] Wed, 4 Jan 2017 02:50:34 GMT (22kb)
[v3] Sat, 21 Jan 2017 02:53:48 GMT (21kb)
[v4] Tue, 30 May 2017 06:20:50 GMT (414kb,D)
Link back to: arXiv, form interface, contact.