We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Networking and Internet Architecture

Title: AirNet: Neural Network Transmission over the Air

Abstract: State-of-the-art performance for many emerging edge applications is achieved by deep neural networks (DNNs). Often, these DNNs are location and time sensitive, and must be delivered from an edge server to the edge device rapidly and efficiently to carry out time-sensitive inference tasks. In this paper, we introduce AirNet, a novel training and transmission method that allows efficient wireless delivery of DNNs under stringent transmit power and latency constraints. We first train the DNN with noise injection to counter the channel noise. We then employ pruning to reduce the network size to the available channel bandwidth, and perform knowledge distillation from a large model to improve the performance. We show that AirNet achieves significantly higher test accuracy compared to digital alternatives under the same bandwidth and power constraints. We further improve the performance of AirNet by pruning the network below the available bandwidth, and using channel expansion to provide better robustness against channel noise. We also benefit from unequal error protection (UEP) by selectively expanding more important layers of the network. Finally, we develop an ensemble training approach, which trains a whole spectrum of DNNs, each of which can be used at different channel condition, resolving the impractical memory requirements.
Subjects: Networking and Internet Architecture (cs.NI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as: arXiv:2105.11166 [cs.NI]
  (or arXiv:2105.11166v5 [cs.NI] for this version)

Submission history

From: Mikolaj Jankowski [view email]
[v1] Mon, 24 May 2021 09:16:04 GMT (1853kb,D)
[v2] Wed, 26 May 2021 15:44:49 GMT (1880kb,D)
[v3] Wed, 9 Feb 2022 11:54:22 GMT (1863kb,D)
[v4] Fri, 11 Nov 2022 16:43:23 GMT (4847kb,D)
[v5] Mon, 21 Nov 2022 12:13:48 GMT (5396kb,D)

Link back to: arXiv, form interface, contact.