Current browse context:
cs.NE
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search
(Submitted on 28 Jan 2020 (v1), last revised 12 Apr 2020 (this version, v2))
Abstract: One-shot neural architecture search (NAS) has played a crucial role in making NAS methods computationally feasible in practice. Nevertheless, there is still a lack of understanding on how these weight-sharing algorithms exactly work due to the many factors controlling the dynamics of the process. In order to allow a scientific study of these components, we introduce a general framework for one-shot NAS that can be instantiated to many recently-introduced variants and introduce a general benchmarking framework that draws on the recent large-scale tabular benchmark NAS-Bench-101 for cheap anytime evaluations of one-shot NAS methods. To showcase the framework, we compare several state-of-the-art one-shot NAS methods, examine how sensitive they are to their hyperparameters and how they can be improved by tuning their hyperparameters, and compare their performance to that of blackbox optimizers for NAS-Bench-101.
Submission history
From: Arber Zela [view email][v1] Tue, 28 Jan 2020 15:50:22 GMT (3194kb,D)
[v2] Sun, 12 Apr 2020 22:48:28 GMT (11074kb,D)
Link back to: arXiv, form interface, contact.