Current browse context:
cs
Change to browse by:
References & Citations
Computer Science > Cryptography and Security
Title: ADI: Adversarial Dominating Inputs in Vertical Federated Learning Systems
(Submitted on 8 Jan 2022 (v1), last revised 11 Apr 2023 (this version, v3))
Abstract: Vertical federated learning (VFL) system has recently become prominent as a concept to process data distributed across many individual sources without the need to centralize it. Multiple participants collaboratively train models based on their local data in a privacy-aware manner. To date, VFL has become a de facto solution to securely learn a model among organizations, allowing knowledge to be shared without compromising privacy of any individuals. Despite the prosperous development of VFL systems, we find that certain inputs of a participant, named adversarial dominating inputs (ADIs), can dominate the joint inference towards the direction of the adversary's will and force other (victim) participants to make negligible contributions, losing rewards that are usually offered regarding the importance of their contributions in federated learning scenarios. We conduct a systematic study on ADIs by first proving their existence in typical VFL systems. We then propose gradient-based methods to synthesize ADIs of various formats and exploit common VFL systems. We further launch greybox fuzz testing, guided by the saliency score of ``victim'' participants, to perturb adversary-controlled inputs and systematically explore the VFL attack surface in a privacy-preserving manner. We conduct an in-depth study on the influence of critical parameters and settings in synthesizing ADIs. Our study reveals new VFL attack opportunities, promoting the identification of unknown threats before breaches and building more secure VFL systems.
Submission history
From: Qi Pang [view email][v1] Sat, 8 Jan 2022 06:18:17 GMT (10702kb,D)
[v2] Mon, 25 Apr 2022 10:31:14 GMT (10703kb,D)
[v3] Tue, 11 Apr 2023 21:48:44 GMT (19554kb,D)
Link back to: arXiv, form interface, contact.