We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Information Theory

Title: Quantized Federated Learning under Transmission Delay and Outage Constraints

Abstract: Federated learning (FL) has been recognized as a viable distributed learning paradigm which trains a machine learning model collaboratively with massive mobile devices in the wireless edge while protecting user privacy. Although various communication schemes have been proposed to expedite the FL process, most of them have assumed ideal wireless channels which provide reliable and lossless communication links between the server and mobile clients. Unfortunately, in practical systems with limited radio resources such as constraint on the training latency and constraints on the transmission power and bandwidth, transmission of a large number of model parameters inevitably suffers from quantization errors (QE) and transmission outage (TO). In this paper, we consider such non-ideal wireless channels, and carry out the first analysis showing that the FL convergence can be severely jeopardized by TO and QE, but intriguingly can be alleviated if the clients have uniform outage probabilities. These insightful results motivate us to propose a robust FL scheme, named FedTOE, which performs joint allocation of wireless resources and quantization bits across the clients to minimize the QE while making the clients have the same TO probability. Extensive experimental results are presented to show the superior performance of FedTOE for deep learning-based classification tasks with transmission latency constraints.
Subjects: Information Theory (cs.IT); Machine Learning (cs.LG)
Journal reference: IEEE Journal on Selected Areas in Communications, vol. 40, no. 1, pp. 323-341, Jan. 2022
DOI: 10.1109/JSAC.2021.3126081
Cite as: arXiv:2106.09397 [cs.IT]
  (or arXiv:2106.09397v3 [cs.IT] for this version)

Submission history

From: Yanmeng Wang [view email]
[v1] Thu, 17 Jun 2021 11:29:12 GMT (1231kb,D)
[v2] Wed, 23 Jun 2021 04:09:00 GMT (1231kb,D)
[v3] Sun, 17 Apr 2022 08:45:25 GMT (780kb,D)

Link back to: arXiv, form interface, contact.