References & Citations
Computer Science > Cryptography and Security
Title: On the Importance of Difficulty Calibration in Membership Inference Attacks
(Submitted on 15 Nov 2021 (v1), last revised 11 Apr 2022 (this version, v2))
Abstract: The vulnerability of machine learning models to membership inference attacks has received much attention in recent years. However, existing attacks mostly remain impractical due to having high false positive rates, where non-member samples are often erroneously predicted as members. This type of error makes the predicted membership signal unreliable, especially since most samples are non-members in real world applications. In this work, we argue that membership inference attacks can benefit drastically from \emph{difficulty calibration}, where an attack's predicted membership score is adjusted to the difficulty of correctly classifying the target sample. We show that difficulty calibration can significantly reduce the false positive rate of a variety of existing attacks without a loss in accuracy.
Submission history
From: Graham Cormode [view email][v1] Mon, 15 Nov 2021 12:32:20 GMT (2474kb,D)
[v2] Mon, 11 Apr 2022 09:23:43 GMT (2823kb,D)
Link back to: arXiv, form interface, contact.