References & Citations
Computer Science > Cryptography and Security
Title: Blades: A Unified Benchmark Suite for Byzantine Attacks and Defenses in Federated Learning
(Submitted on 10 Jun 2022 (v1), last revised 10 Nov 2023 (this version, v4))
Abstract: Federated learning (FL) facilitates distributed training across different IoT and edge devices, safeguarding the privacy of their data. The inherent distributed structure of FL introduces vulnerabilities, especially from adversarial devices aiming to skew local updates to their advantage. Despite the plethora of research focusing on Byzantine-resilient FL, the academic community has yet to establish a comprehensive benchmark suite, pivotal for impartial assessment and comparison of different techniques. This paper presents Blades, a scalable, extensible, and easily configurable benchmark suite that supports researchers and developers in efficiently implementing and validating novel strategies against baseline algorithms in Byzantine-resilient FL. Blades contains built-in implementations of representative attack and defense strategies and offers a user-friendly interface that seamlessly integrates new ideas. Using Blades, we re-evaluate representative attacks and defenses on wide-ranging experimental configurations (approximately 1,500 trials in total). Through our extensive experiments, we gained new insights into FL robustness and highlighted previously overlooked limitations due to the absence of thorough evaluations and comparisons of baselines under various attack settings.
Submission history
From: Shenghui Li [view email][v1] Fri, 10 Jun 2022 21:25:25 GMT (806kb,D)
[v2] Thu, 7 Sep 2023 23:15:22 GMT (10636kb,D)
[v3] Thu, 19 Oct 2023 08:57:28 GMT (4925kb,D)
[v4] Fri, 10 Nov 2023 14:34:21 GMT (5858kb,D)
Link back to: arXiv, form interface, contact.