References & Citations
Computer Science > Neural and Evolutionary Computing
Title: Evolution and Efficiency in Neural Architecture Search: Bridging the Gap Between Expert Design and Automated Optimization
(Submitted on 11 Feb 2024 (v1), last revised 2 Apr 2024 (this version, v2))
Abstract: The paper provides a comprehensive overview of Neural Architecture Search (NAS), emphasizing its evolution from manual design to automated, computationally-driven approaches. It covers the inception and growth of NAS, highlighting its application across various domains, including medical imaging and natural language processing. The document details the shift from expert-driven design to algorithm-driven processes, exploring initial methodologies like reinforcement learning and evolutionary algorithms. It also discusses the challenges of computational demands and the emergence of efficient NAS methodologies, such as Differentiable Architecture Search and hardware-aware NAS. The paper further elaborates on NAS's application in computer vision, NLP, and beyond, demonstrating its versatility and potential for optimizing neural network architectures across different tasks. Future directions and challenges, including computational efficiency and the integration with emerging AI domains, are addressed, showcasing NAS's dynamic nature and its continued evolution towards more sophisticated and efficient architecture search methods.
Submission history
From: Fanfei Meng [view email][v1] Sun, 11 Feb 2024 18:27:29 GMT (147kb)
[v2] Tue, 2 Apr 2024 06:35:04 GMT (426kb)
Link back to: arXiv, form interface, contact.