Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: An ADMM Based Framework for AutoML Pipeline Configuration
(Submitted on 1 May 2019 (v1), last revised 6 Dec 2019 (this version, v5))
Abstract: We study the AutoML problem of automatically configuring machine learning pipelines by jointly selecting algorithms and their appropriate hyper-parameters for all steps in supervised learning pipelines. This black-box (gradient-free) optimization with mixed integer & continuous variables is a challenging problem. We propose a novel AutoML scheme by leveraging the alternating direction method of multipliers (ADMM). The proposed framework is able to (i) decompose the optimization problem into easier sub-problems that have a reduced number of variables and circumvent the challenge of mixed variable categories, and (ii) incorporate black-box constraints along-side the black-box optimization objective. We empirically evaluate the flexibility (in utilizing existing AutoML techniques), effectiveness (against open source AutoML toolkits),and unique capability (of executing AutoML with practically motivated black-box constraints) of our proposed scheme on a collection of binary classification data sets from UCI ML& OpenML repositories. We observe that on an average our framework provides significant gains in comparison to other AutoML frameworks (Auto-sklearn & TPOT), highlighting the practical advantages of this framework.
Submission history
From: Sijia Liu [view email][v1] Wed, 1 May 2019 16:51:52 GMT (2432kb,D)
[v2] Mon, 10 Jun 2019 02:36:20 GMT (3490kb,D)
[v3] Tue, 19 Nov 2019 00:19:13 GMT (3356kb,D)
[v4] Thu, 21 Nov 2019 06:55:45 GMT (3930kb,D)
[v5] Fri, 6 Dec 2019 19:27:12 GMT (3930kb,D)
Link back to: arXiv, form interface, contact.