Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Towards Federated Learning With Byzantine-Robust Client Weighting
(Submitted on 10 Apr 2020 (v1), last revised 18 May 2021 (this version, v2))
Abstract: Federated Learning (FL) is a distributed machine learning paradigm where data is distributed among clients who collaboratively train a model in a computation process coordinated by a central server. By assigning a weight to each client based on the proportion of data instances it possesses, the rate of convergence to an accurate joint model can be greatly accelerated. Some previous works studied FL in a Byzantine setting, in which a fraction of the clients may send arbitrary or even malicious information regarding their model. However, these works either ignore the issue of data unbalancedness altogether or assume that client weights are apriori known to the server, whereas, in practice, it is likely that weights will be reported to the server by the clients themselves and therefore cannot be relied upon. We address this issue for the first time by proposing a practical weight-truncation-based preprocessing method and demonstrating empirically that it is able to strike a good balance between model quality and Byzantine robustness. We also establish analytically that our method can be applied to a randomly selected sample of client weights.
Submission history
From: Amit Portnoy [view email][v1] Fri, 10 Apr 2020 10:59:16 GMT (235kb,D)
[v2] Tue, 18 May 2021 08:10:10 GMT (271kb,D)
Link back to: arXiv, form interface, contact.