We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Do We Need Anisotropic Graph Neural Networks?

Abstract: Common wisdom in the graph neural network (GNN) community dictates that anisotropic models -- in which messages sent between nodes are a function of both the source and target node -- are required to achieve state-of-the-art performance. Benchmarks to date have demonstrated that these models perform better than comparable isotropic models -- where messages are a function of the source node only. In this work we provide empirical evidence challenging this narrative: we propose an isotropic GNN, which we call Efficient Graph Convolution (EGC), that consistently outperforms comparable anisotropic models, including the popular GAT or PNA architectures by using spatially-varying adaptive filters. In addition to raising important questions for the GNN community, our work has significant real-world implications for efficiency. EGC achieves higher model accuracy, with lower memory consumption and latency, along with characteristics suited to accelerator implementation, while being a drop-in replacement for existing architectures. As an isotropic model, it requires memory proportional to the number of vertices in the graph ($\mathcal{O}(V)$); in contrast, anisotropic models require memory proportional to the number of edges ($\mathcal{O}(E)$). We demonstrate that EGC outperforms existing approaches across 6 large and diverse benchmark datasets, and conclude by discussing questions that our work raise for the community going forward. Code and pretrained models for our experiments are provided at this https URL
Comments: Published as a conference paper at ICLR 2022
Subjects: Machine Learning (cs.LG)
Cite as: arXiv:2104.01481 [cs.LG]
  (or arXiv:2104.01481v5 [cs.LG] for this version)

Submission history

From: Shyam Tailor [view email]
[v1] Sat, 3 Apr 2021 20:54:36 GMT (378kb,D)
[v2] Sat, 10 Apr 2021 17:31:25 GMT (378kb,D)
[v3] Sun, 27 Feb 2022 23:41:37 GMT (81kb,D)
[v4] Wed, 13 Apr 2022 16:33:08 GMT (114kb,D)
[v5] Mon, 9 May 2022 10:39:40 GMT (114kb,D)

Link back to: arXiv, form interface, contact.