We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Grid Search, Random Search, Genetic Algorithm: A Big Comparison for NAS

Abstract: In this paper, we compare the three most popular algorithms for hyperparameter optimization (Grid Search, Random Search, and Genetic Algorithm) and attempt to use them for neural architecture search (NAS). We use these algorithms for building a convolutional neural network (search architecture). Experimental results on CIFAR-10 dataset further demonstrate the performance difference between compared algorithms. The comparison results are based on the execution time of the above algorithms and accuracy of the proposed models.
Comments: 11 pages, 5 figures, 3 tables
Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)
Cite as: arXiv:1912.06059 [cs.LG]
  (or arXiv:1912.06059v1 [cs.LG] for this version)

Submission history

From: Petro Liashchynskyi [view email]
[v1] Thu, 12 Dec 2019 16:07:20 GMT (2766kb,D)

Link back to: arXiv, form interface, contact.