References & Citations
Computer Science > Machine Learning
Title: SMGRL: Scalable Multi-resolution Graph Representation Learning
(Submitted on 29 Jan 2022 (v1), last revised 15 Aug 2023 (this version, v3))
Abstract: Graph convolutional networks (GCNs) allow us to learn topologically-aware node embeddings, which can be useful for classification or link prediction. However, they are unable to capture long-range dependencies between nodes without adding additional layers -- which in turn leads to over-smoothing and increased time and space complexity. Further, the complex dependencies between nodes make mini-batching challenging, limiting their applicability to large graphs. We propose a Scalable Multi-resolution Graph Representation Learning (SMGRL) framework that enables us to learn multi-resolution node embeddings efficiently. Our framework is model-agnostic and can be applied to any existing GCN model. We dramatically reduce training costs by training only on a reduced-dimension coarsening of the original graph, then exploit self-similarity to apply the resulting algorithm at multiple resolutions. The resulting multi-resolution embeddings can be aggregated to yield high-quality node embeddings that capture both long- and short-range dependencies. Our experiments show that this leads to improved classification accuracy, without incurring high computational costs.
Submission history
From: Reza Namazi [view email][v1] Sat, 29 Jan 2022 21:48:48 GMT (13511kb,D)
[v2] Fri, 3 Feb 2023 21:44:02 GMT (16541kb,D)
[v3] Tue, 15 Aug 2023 18:55:42 GMT (25463kb,D)
Link back to: arXiv, form interface, contact.