We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Riemannian Stochastic Approximation for Minimizing Tame Nonsmooth Objective Functions

Abstract: In many learning applications, the parameters in a model are structurally constrained in a way that can be modeled as them lying on a Riemannian manifold. Riemannian optimization, wherein procedures to enforce an iterative minimizing sequence to be constrained to the manifold, is used to train such models. At the same time, tame geometry has become a significant topological description of nonsmooth functions that appear in the landscapes of training neural networks and other important models with structural compositions of continuous nonlinear functions with nonsmooth maps. In this paper, we study the properties of such stratifiable functions on a manifold and the behavior of retracted stochastic gradient descent, with diminishing stepsizes, for minimizing such functions.
Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)
Cite as: arXiv:2302.00709 [cs.LG]
  (or arXiv:2302.00709v3 [cs.LG] for this version)

Submission history

From: Vyacheslav Kungurtsev [view email]
[v1] Wed, 1 Feb 2023 19:03:00 GMT (309kb,D)
[v2] Mon, 6 Feb 2023 20:14:13 GMT (310kb,D)
[v3] Wed, 8 Feb 2023 18:44:42 GMT (310kb,D)

Link back to: arXiv, form interface, contact.