We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Stability to Deformations of Manifold Filters and Manifold Neural Networks

Abstract: The paper defines and studies manifold (M) convolutional filters and neural networks (NNs). \emph{Manifold} filters and MNNs are defined in terms of the Laplace-Beltrami operator exponential and are such that \emph{graph} (G) filters and neural networks (NNs) are recovered as discrete approximations when the manifold is sampled. These filters admit a spectral representation which is a generalization of both the spectral representation of graph filters and the frequency response of standard convolutional filters in continuous time. The main technical contribution of the paper is to analyze the stability of manifold filters and MNNs to smooth deformations of the manifold. This analysis generalizes known stability properties of graph filters and GNNs and it is also a generalization of known stability properties of standard convolutional filters and neural networks in continuous time. The most important observation that follows from this analysis is that manifold filters, same as graph filters and standard continuous time filters, have difficulty discriminating high frequency components in the presence of deformations. This is a challenge that can be ameliorated with the use of manifold, graph, or continuous time neural networks. The most important practical consequence of this analysis is to shed light on the behavior of graph filters and GNNs in large-scale graphs.
Comments: 19 pages; 6 figures
Subjects: Machine Learning (cs.LG)
Cite as: arXiv:2106.03725 [cs.LG]
  (or arXiv:2106.03725v5 [cs.LG] for this version)

Submission history

From: Zhiyang Wang [view email]
[v1] Mon, 7 Jun 2021 15:41:03 GMT (61kb)
[v2] Thu, 12 May 2022 21:29:56 GMT (1178kb,D)
[v3] Fri, 21 Oct 2022 14:17:22 GMT (593kb,D)
[v4] Tue, 12 Sep 2023 15:45:20 GMT (618kb,D)
[v5] Thu, 14 Mar 2024 18:39:42 GMT (625kb,D)

Link back to: arXiv, form interface, contact.