Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: MorphNet: Fast & Simple Resource-Constrained Structure Learning of Deep Networks
(Submitted on 18 Nov 2017 (v1), last revised 17 Apr 2018 (this version, v3))
Abstract: We present MorphNet, an approach to automate the design of neural network structures. MorphNet iteratively shrinks and expands a network, shrinking via a resource-weighted sparsifying regularizer on activations and expanding via a uniform multiplicative factor on all layers. In contrast to previous approaches, our method is scalable to large networks, adaptable to specific resource constraints (e.g. the number of floating-point operations per inference), and capable of increasing the network's performance. When applied to standard network architectures on a wide variety of datasets, our approach discovers novel structures in each domain, obtaining higher performance while respecting the resource constraint.
Submission history
From: Elad Eban [view email][v1] Sat, 18 Nov 2017 02:33:39 GMT (242kb,D)
[v2] Thu, 30 Nov 2017 06:38:56 GMT (292kb,D)
[v3] Tue, 17 Apr 2018 19:07:21 GMT (113kb,D)
Link back to: arXiv, form interface, contact.