References & Citations
Computer Science > Machine Learning
Title: Node-Level Differentially Private Graph Neural Networks
(Submitted on 23 Nov 2021 (v1), last revised 26 Aug 2022 (this version, v3))
Abstract: Graph Neural Networks (GNNs) are a popular technique for modelling graph-structured data and computing node-level representations via aggregation of information from the neighborhood of each node. However, this aggregation implies an increased risk of revealing sensitive information, as a node can participate in the inference for multiple nodes. This implies that standard privacy-preserving machine learning techniques, such as differentially private stochastic gradient descent (DP-SGD) - which are designed for situations where each data point participates in the inference for one point only - either do not apply, or lead to inaccurate models. In this work, we formally define the problem of learning GNN parameters with node-level privacy, and provide an algorithmic solution with a strong differential privacy guarantee. We employ a careful sensitivity analysis and provide a non-trivial extension of the privacy-by-amplification technique to the GNN setting. An empirical evaluation on standard benchmark datasets demonstrates that our method is indeed able to learn accurate privacy-preserving GNNs which outperform both private and non-private methods that completely ignore graph information.
Submission history
From: Ameya Daigavane [view email][v1] Tue, 23 Nov 2021 16:18:53 GMT (419kb,D)
[v2] Mon, 6 Dec 2021 10:29:09 GMT (419kb,D)
[v3] Fri, 26 Aug 2022 19:12:58 GMT (432kb,D)
Link back to: arXiv, form interface, contact.