Current browse context:
math.OC
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Accelerated Stochastic Mirror Descent Algorithms For Composite Non-strongly Convex Optimization
(Submitted on 23 May 2016 (v1), revised 11 Jul 2017 (this version, v3), latest version 31 Dec 2018 (v6))
Abstract: We consider the problem of minimizing the sum of an average function of a large number of smooth convex components and a general, possibly non-differentiable, convex function. Although many methods have been proposed to solve this problem with the assumption that the sum is strongly convex, few methods support the non-strongly convex cases. Adding a small quadratic regularization is a common trick used to tackle non-strongly convex problems; however, it may worsen the quality of solutions or weaken the performance of the algorithms. Avoiding this trick, we propose a new accelerated stochastic mirror descent method for solving the problem without the strongly convex assumption. Our method extends the deterministic accelerated proximal gradient methods of Paul Tseng and can be applied even when proximal points are computed inexactly. Our direct algorithms can be proven to achieve the optimal convergence rate $O(\frac{1}{k^2})$ under a suitable choice of the errors in calculating the proximal points. We also propose a scheme for solving the problem when the component functions are non-smooth and finally apply the new algorithms to a class of composite convex concave optimization problems.
Submission history
From: Khanh Hien Le [view email][v1] Mon, 23 May 2016 04:21:07 GMT (46kb,D)
[v2] Tue, 24 May 2016 02:15:13 GMT (46kb,D)
[v3] Tue, 11 Jul 2017 00:55:24 GMT (173kb,D)
[v4] Mon, 24 Jul 2017 10:23:14 GMT (162kb,D)
[v5] Tue, 17 Jul 2018 16:52:04 GMT (4154kb,D)
[v6] Mon, 31 Dec 2018 18:48:15 GMT (4155kb,D)
Link back to: arXiv, form interface, contact.