Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: DP-REC: Private & Communication-Efficient Federated Learning
(Submitted on 9 Nov 2021 (v1), last revised 7 Dec 2021 (this version, v2))
Abstract: Privacy and communication efficiency are important challenges in federated training of neural networks, and combining them is still an open problem. In this work, we develop a method that unifies highly compressed communication and differential privacy (DP). We introduce a compression technique based on Relative Entropy Coding (REC) to the federated setting. With a minor modification to REC, we obtain a provably differentially private learning algorithm, DP-REC, and show how to compute its privacy guarantees. Our experiments demonstrate that DP-REC drastically reduces communication costs while providing privacy guarantees comparable to the state-of-the-art.
Submission history
From: Aleksei Triastcyn [view email][v1] Tue, 9 Nov 2021 23:33:11 GMT (1336kb,D)
[v2] Tue, 7 Dec 2021 21:56:09 GMT (4503kb,D)
Link back to: arXiv, form interface, contact.