We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: A Smoothing Riemannian Gradient Algorithm Framework for Nonsmooth Optimization Problem on Manifold

Abstract: In this paper, we introduce the notion of generalized $\epsilon$-stationarity for a class of nonconvex and nonsmooth composite minimization problems on Riemannian manifolds embedding in Euclidean space. To find a generalized $\epsilon$-stationarity point, we develop a family of Riemannian gradient type methods based on the Moreau envelope technique with a decreasing sequence of smoothing parameters, namely Riemannian smoothing gradient and Riemannian smoothing stochastic gradient methods. We prove that the Riemannian smoothing gradient method has the iteration complexity of $\mathcal{O}(\epsilon^{-3})$ for driving a generalized $\epsilon$-stationary point. To our knowledge, this is the best-known computational complexity result for the nonconvex and nonsmooth composite problem on manifolds. For the Riemannian smoothing stochastic gradient method, one can achieve the iteration complexity of $\mathcal{O}(\epsilon^{-5})$ for driving a generalized $\epsilon$-stationary point.
Subjects: Optimization and Control (math.OC)
Cite as: arXiv:2212.03526 [math.OC]
  (or arXiv:2212.03526v2 [math.OC] for this version)

Submission history

From: Zheng Peng [view email]
[v1] Wed, 7 Dec 2022 09:13:45 GMT (686kb)
[v2] Sun, 18 Dec 2022 10:08:28 GMT (513kb)

Link back to: arXiv, form interface, contact.