We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Theory

Title: Turning Channel Noise into an Accelerator for Over-the-Air Principal Component Analysis

Abstract: Recently years, the attempts on distilling mobile data into useful knowledge has been led to the deployment of machine learning algorithms at the network edge. Principal component analysis (PCA) is a classic technique for extracting the linear structure of a dataset, which is useful for feature extraction and data compression. In this work, we propose the deployment of distributed PCA over a multi-access channel based on the algorithm of stochastic gradient descent to learn the dominant feature space of a distributed dataset at multiple devices. Over-the-air aggregation is adopted to reduce the multi-access latency, giving the name over-the-air PCA. The novelty of this design lies in exploiting channel noise to accelerate the descent in the region around each saddle point encountered by gradient descent, thereby increasing the convergence speed of over-the-air PCA. The idea is materialized by proposing a power-control scheme which detects the type of descent region and controlling the level of channel noise accordingly. The scheme is proved to achieve a faster convergence rate than in the case without power control.
Comments: 16 pages,9 figures, accepted by IEEE TWC for publication
Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Networking and Internet Architecture (cs.NI); Signal Processing (eess.SP)
Cite as: arXiv:2104.10095 [cs.IT]
  (or arXiv:2104.10095v3 [cs.IT] for this version)

Submission history

From: Zezhong Zhang [view email]
[v1] Tue, 20 Apr 2021 16:28:33 GMT (6808kb,D)
[v2] Wed, 21 Apr 2021 02:21:15 GMT (6808kb,D)
[v3] Fri, 1 Apr 2022 15:54:50 GMT (11111kb,D)

Link back to: arXiv, form interface, contact.