We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: The Deep Learning Revolution and Its Implications for Computer Architecture and Chip Design

Authors: Jeffrey Dean
Abstract: The past decade has seen a remarkable series of advances in machine learning, and in particular deep learning approaches based on artificial neural networks, to improve our abilities to build more accurate systems across a broad range of areas, including computer vision, speech recognition, language translation, and natural language understanding tasks. This paper is a companion paper to a keynote talk at the 2020 International Solid-State Circuits Conference (ISSCC) discussing some of the advances in machine learning, and their implications on the kinds of computational devices we need to build, especially in the post-Moore's Law-era. It also discusses some of the ways that machine learning may also be able to help with some aspects of the circuit design process. Finally, it provides a sketch of at least one interesting direction towards much larger-scale multi-task models that are sparsely activated and employ much more dynamic, example- and task-based routing than the machine learning models of today.
Comments: Companion paper to accompany a keynote talk at ISSCC 2020
Subjects: Machine Learning (cs.LG); Hardware Architecture (cs.AR); Machine Learning (stat.ML)
Cite as: arXiv:1911.05289 [cs.LG]
  (or arXiv:1911.05289v1 [cs.LG] for this version)

Submission history

From: Jeffrey Dean [view email]
[v1] Wed, 13 Nov 2019 04:41:31 GMT (1049kb)

Link back to: arXiv, form interface, contact.