We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cond-mat.dis-nn

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systems

Abstract: Deep neural networks have become a pervasive tool in science and engineering. However, modern deep neural networks' growing energy requirements now increasingly limit their scaling and broader use. We propose a radical alternative for implementing deep neural network models: Physical Neural Networks. We introduce a hybrid physical-digital algorithm called Physics-Aware Training to efficiently train sequences of controllable physical systems to act as deep neural networks. This method automatically trains the functionality of any sequence of real physical systems, directly, using backpropagation, the same technique used for modern deep neural networks. To illustrate their generality, we demonstrate physical neural networks with three diverse physical systems-optical, mechanical, and electrical. Physical neural networks may facilitate unconventional machine learning hardware that is orders of magnitude faster and more energy efficient than conventional electronic processors.
Subjects: Machine Learning (cs.LG); Disordered Systems and Neural Networks (cond-mat.dis-nn); Emerging Technologies (cs.ET); Optics (physics.optics)
Journal reference: Nature 601, 549-555 (2022)
DOI: 10.1038/s41586-021-04223-6
Cite as: arXiv:2104.13386 [cs.LG]
  (or arXiv:2104.13386v1 [cs.LG] for this version)

Submission history

From: Tatsuhiro Onodera Mr. [view email]
[v1] Tue, 27 Apr 2021 18:00:02 GMT (22252kb,D)

Link back to: arXiv, form interface, contact.