Current browse context:
cs
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Approximate Frank-Wolfe Algorithms over Graph-structured Support Sets
(Submitted on 29 Jun 2021 (v1), last revised 17 Jun 2022 (this version, v3))
Abstract: In this paper, we consider approximate Frank-Wolfe (FW) algorithms to solve convex optimization problems over graph-structured support sets where the linear minimization oracle (LMO) cannot be efficiently obtained in general. We first demonstrate that two popular approximation assumptions (additive and multiplicative gap errors) are not applicable in that no cheap gap-approximate LMO oracle exists. Thus, approximate dual maximization oracles (DMO) are proposed, which approximate the inner product rather than the gap. We prove that the standard FW method using a $\delta$-approximate DMO converges as $\mathcal{O}((1-\delta) \sqrt{s}/\delta)$ in the worst case, and as $\mathcal{O}(L/(\delta^2 t))$ over a $\delta$-relaxation of the constraint set. Furthermore, when the solution is on the boundary, a variant of FW converges as $\mathcal{O}(1/t^2)$ under the quadratic growth assumption. Our empirical results suggest that even these improved bounds are pessimistic, showing fast convergence in recovering real-world images with graph-structured sparsity.
Submission history
From: Baojian Zhou [view email][v1] Tue, 29 Jun 2021 19:39:43 GMT (13469kb,D)
[v2] Thu, 16 Jun 2022 17:11:49 GMT (2981kb,D)
[v3] Fri, 17 Jun 2022 03:42:18 GMT (2981kb,D)
Link back to: arXiv, form interface, contact.