Current browse context:
math.OC
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Stochastic Frank-Wolfe Methods for Nonconvex Optimization
(Submitted on 27 Jul 2016 (v1), last revised 29 Jul 2016 (this version, v2))
Abstract: We study Frank-Wolfe methods for nonconvex stochastic and finite-sum optimization problems. Frank-Wolfe methods (in the convex case) have gained tremendous recent interest in machine learning and optimization communities due to their projection-free property and their ability to exploit structured constraints. However, our understanding of these algorithms in the nonconvex setting is fairly limited. In this paper, we propose nonconvex stochastic Frank-Wolfe methods and analyze their convergence properties. For objective functions that decompose into a finite-sum, we leverage ideas from variance reduction techniques for convex optimization to obtain new variance reduced nonconvex Frank-Wolfe methods that have provably faster convergence than the classical Frank-Wolfe method. Finally, we show that the faster convergence rates of our variance reduced methods also translate into improved convergence rates for the stochastic setting.
Submission history
From: Sashank J. Reddi [view email][v1] Wed, 27 Jul 2016 20:03:47 GMT (509kb,D)
[v2] Fri, 29 Jul 2016 05:01:34 GMT (509kb,D)
Link back to: arXiv, form interface, contact.