Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Stochastic Zeroth-order Optimization in High Dimensions
(Submitted on 29 Oct 2017 (v1), last revised 26 Feb 2018 (this version, v2))
Abstract: We consider the problem of optimizing a high-dimensional convex function using stochastic zeroth-order queries. Under sparsity assumptions on the gradients or function values, we present two algorithms: a successive component/feature selection algorithm and a noisy mirror descent algorithm using Lasso gradient estimates, and show that both algorithms have convergence rates that de- pend only logarithmically on the ambient dimension of the problem. Empirical results confirm our theoretical findings and show that the algorithms we design outperform classical zeroth-order optimization methods in the high-dimensional setting.
Submission history
From: Yining Wang [view email][v1] Sun, 29 Oct 2017 02:11:48 GMT (73kb,D)
[v2] Mon, 26 Feb 2018 02:26:27 GMT (73kb,D)
Link back to: arXiv, form interface, contact.