Current browse context:
math.OC
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Projection-free nonconvex stochastic optimization on Riemannian manifolds
(Submitted on 9 Oct 2019 (v1), last revised 3 Apr 2021 (this version, v3))
Abstract: We study stochastic projection-free methods for constrained optimization of smooth functions on Riemannian manifolds, i.e., with additional constraints beyond the parameter domain being a manifold. Specifically, we introduce stochastic Riemannian Frank-Wolfe methods for nonconvex and geodesically convex problems. We present algorithms for both purely stochastic optimization and finite-sum problems. For the latter, we develop variance-reduced methods, including a Riemannian adaptation of the recently proposed Spider technique. For all settings, we recover convergence rates that are comparable to the best-known rates for their Euclidean counterparts. Finally, we discuss applications to two classic tasks: The computation of the Karcher mean of positive definite matrices and Wasserstein barycenters for multivariate normal distributions. For both tasks, stochastic Fw methods yield state-of-the-art empirical performance.
Submission history
From: Melanie Weber [view email][v1] Wed, 9 Oct 2019 18:27:25 GMT (913kb,D)
[v2] Fri, 27 Mar 2020 15:18:46 GMT (1888kb,D)
[v3] Sat, 3 Apr 2021 16:38:56 GMT (1967kb,D)
Link back to: arXiv, form interface, contact.