References & Citations
Computer Science > Cryptography and Security
Title: Fine-grained Poisoning Attack to Local Differential Privacy Protocols for Mean and Variance Estimation
(Submitted on 24 May 2022 (v1), revised 26 Feb 2023 (this version, v3), latest version 10 Mar 2023 (v4))
Abstract: Although local differential privacy (LDP) protects individual users' data from inference by an untrusted data curator, recent studies show that an attacker can launch a data poisoning attack from the user side to inject carefully-crafted bogus data into the LDP protocols in order to maximally skew the final estimate by the data curator.
In this work, we further advance this knowledge by proposing a new fine-grained attack, which allows the attacker to fine-tune and simultaneously manipulate mean and variance estimations that are popular analytical tasks for many real-world applications. To accomplish this goal, the attack leverages the characteristics of LDP to inject fake data into the output domain of the local LDP instance. We call our attack the output poisoning attack (OPA). We observe a security-privacy consistency where a small privacy loss enhances the security of LDP, which contradicts the known security-privacy trade-off from prior work. We further study the consistency and reveal a more holistic view of the threat landscape of data poisoning attacks on LDP. We comprehensively evaluate our attack against a baseline attack that intuitively provides false input to LDP. The experimental results show that OPA outperforms the baseline on three real-world datasets. We also propose a novel defense method that can recover the result accuracy from polluted data collection and offer insight into the secure LDP design.
Submission history
From: Xiaoguang Li [view email][v1] Tue, 24 May 2022 04:43:43 GMT (403kb,D)
[v2] Wed, 12 Oct 2022 11:20:15 GMT (322kb,D)
[v3] Sun, 26 Feb 2023 16:19:30 GMT (2106kb,D)
[v4] Fri, 10 Mar 2023 14:37:29 GMT (2107kb,D)
Link back to: arXiv, form interface, contact.