We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Higher-Order Explanations of Graph Neural Networks via Relevant Walks

Abstract: Graph Neural Networks (GNNs) are a popular approach for predicting graph structured data. As GNNs tightly entangle the input graph into the neural network structure, common explainable AI approaches are not applicable. To a large extent, GNNs have remained black-boxes for the user so far. In this paper, we show that GNNs can in fact be naturally explained using higher-order expansions, i.e. by identifying groups of edges that jointly contribute to the prediction. Practically, we find that such explanations can be extracted using a nested attribution scheme, where existing techniques such as layer-wise relevance propagation (LRP) can be applied at each step. The output is a collection of walks into the input graph that are relevant for the prediction. Our novel explanation method, which we denote by GNN-LRP, is applicable to a broad range of graph neural networks and lets us extract practically relevant insights on sentiment analysis of text data, structure-property relationships in quantum chemistry, and image classification.
Comments: 14 pages + 6 pages supplement
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)
DOI: 10.1109/TPAMI.2021.3115452
Cite as: arXiv:2006.03589 [cs.LG]
  (or arXiv:2006.03589v3 [cs.LG] for this version)

Submission history

From: Grégoire Montavon [view email]
[v1] Fri, 5 Jun 2020 17:59:14 GMT (5100kb,D)
[v2] Fri, 12 Jun 2020 15:49:11 GMT (5099kb,D)
[v3] Fri, 27 Nov 2020 04:10:00 GMT (3350kb,D)

Link back to: arXiv, form interface, contact.