Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Are Graph Neural Networks Miscalibrated?
(Submitted on 7 May 2019 (v1), last revised 3 Jun 2019 (this version, v2))
Abstract: Graph Neural Networks (GNNs) have proven to be successful in many classification tasks, outperforming previous state-of-the-art methods in terms of accuracy. However, accuracy alone is not enough for high-stakes decision making. Decision makers want to know the likelihood that a specific GNN prediction is correct. For this purpose, obtaining calibrated models is essential. In this work, we perform an empirical evaluation of the calibration of state-of-the-art GNNs on multiple datasets. Our experiments show that GNNs can be calibrated in some datasets but also badly miscalibrated in others, and that state-of-the-art calibration methods are helpful but do not fix the problem.
Submission history
From: Leonardo Teixeira [view email][v1] Tue, 7 May 2019 00:05:31 GMT (246kb,D)
[v2] Mon, 3 Jun 2019 14:10:50 GMT (1074kb,D)
Link back to: arXiv, form interface, contact.