Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Learning Globally Smooth Functions on Manifolds
(Submitted on 1 Oct 2022 (v1), last revised 1 Feb 2023 (this version, v3))
Abstract: Smoothness and low dimensional structures play central roles in improving generalization and stability in learning and statistics. This work combines techniques from semi-infinite constrained learning and manifold regularization to learn representations that are globally smooth on a manifold. To do so, it shows that under typical conditions the problem of learning a Lipschitz continuous function on a manifold is equivalent to a dynamically weighted manifold regularization problem. This observation leads to a practical algorithm based on a weighted Laplacian penalty whose weights are adapted using stochastic gradient techniques. It is shown that under mild conditions, this method estimates the Lipschitz constant of the solution, learning a globally smooth solution as a byproduct. Experiments on real world data illustrate the advantages of the proposed method relative to existing alternatives.
Submission history
From: Juan Cervino [view email][v1] Sat, 1 Oct 2022 15:45:35 GMT (10240kb,D)
[v2] Tue, 18 Oct 2022 18:38:07 GMT (12043kb,D)
[v3] Wed, 1 Feb 2023 22:32:59 GMT (23303kb,D)
Link back to: arXiv, form interface, contact.