Current browse context:
math.OC
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Accelerated Stochastic Quasi-Newton Optimization on Riemann Manifolds
(Submitted on 6 Apr 2017 (v1), last revised 22 May 2017 (this version, v3))
Abstract: We propose an L-BFGS optimization algorithm on Riemannian manifolds using minibatched stochastic variance reduction techniques for fast convergence with constant step sizes, without resorting to linesearch methods designed to satisfy Wolfe conditions. We provide a new convergence proof for strongly convex functions without using curvature conditions on the manifold, as well as a convergence discussion for nonconvex functions. We discuss a couple of ways to obtain the correction pairs used to calculate the product of the gradient with the inverse Hessian, and empirically demonstrate their use in synthetic experiments on computation of Karcher means for symmetric positive definite matrices and leading eigenvalues of large scale data matrices. We compare our method to VR-PCA for the latter experiment, along with Riemannian SVRG for both cases, and show strong convergence results for a range of datasets.
Submission history
From: Anirban Roychowdhury [view email][v1] Thu, 6 Apr 2017 03:34:29 GMT (315kb,D)
[v2] Wed, 12 Apr 2017 22:02:30 GMT (316kb,D)
[v3] Mon, 22 May 2017 15:02:02 GMT (434kb,D)
Link back to: arXiv, form interface, contact.