We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Graph Random Neural Network for Semi-Supervised Learning on Graphs

Abstract: We study the problem of semi-supervised learning on graphs, for which graph neural networks (GNNs) have been extensively explored. However, most existing GNNs inherently suffer from the limitations of over-smoothing, non-robustness, and weak-generalization when labeled nodes are scarce. In this paper, we propose a simple yet effective framework -- GRAPH RANDOM NEURAL NETWORKS (GRAND) -- to address these issues. In GRAND, we first design a random propagation strategy to perform graph data augmentation. Then we leverage consistency regularization to optimize the prediction consistency of unlabeled nodes across different data augmentations. Extensive experiments on graph benchmark datasets suggest that GRAND significantly outperforms state-of-the-art GNN baselines on semi-supervised node classification. Finally, we show that GRAND mitigates the issues of over-smoothing and non-robustness, exhibiting better generalization behavior than existing GNNs. The source code of GRAND is publicly available at this https URL
Comments: 18 pages. NeurIPS 2020 Oral. Final version
Subjects: Machine Learning (cs.LG); Social and Information Networks (cs.SI); Machine Learning (stat.ML)
Cite as: arXiv:2005.11079 [cs.LG]
  (or arXiv:2005.11079v4 [cs.LG] for this version)

Submission history

From: Wenzheng Feng [view email]
[v1] Fri, 22 May 2020 09:40:13 GMT (15734kb,D)
[v2] Wed, 7 Oct 2020 07:51:17 GMT (30488kb,D)
[v3] Mon, 26 Oct 2020 05:21:52 GMT (26692kb,D)
[v4] Tue, 21 Sep 2021 04:09:10 GMT (26637kb,D)

Link back to: arXiv, form interface, contact.