We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Stability and Generalization Capabilities of Message Passing Graph Neural Networks

Abstract: Message passing neural networks (MPNN) have seen a steep rise in popularity since their introduction as generalizations of convolutional neural networks to graph structured data, and are now considered state-of-the-art tools for solving a large variety of graph-focused problems. We study the generalization capabilities of MPNNs in graph classification. We assume that graphs of different classes are sampled from different random graph models. Based on this data distribution, we derive a non-asymptotic bound on the generalization gap between the empirical and statistical loss, that decreases to zero as the graphs become larger. This is proven by showing that a MPNN, applied on a graph, approximates the MPNN applied on the geometric model that the graph discretizes.
Comments: 44 pages, typos corrected, preprint
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Numerical Analysis (math.NA); Probability (math.PR)
MSC classes: 68T07, 68R10
Cite as: arXiv:2202.00645 [cs.LG]
  (or arXiv:2202.00645v3 [cs.LG] for this version)

Submission history

From: Sohir Maskey [view email]
[v1] Tue, 1 Feb 2022 18:37:53 GMT (18878kb,D)
[v2] Fri, 4 Feb 2022 18:12:15 GMT (18894kb,D)
[v3] Thu, 31 Mar 2022 15:37:15 GMT (19019kb,D)
[v4] Thu, 19 May 2022 15:41:44 GMT (15604kb,D)
[v5] Thu, 26 May 2022 17:35:11 GMT (15704kb,D)
[v6] Thu, 4 Aug 2022 17:28:19 GMT (15907kb,D)

Link back to: arXiv, form interface, contact.