Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: A Domain-Shrinking based Bayesian Optimization Algorithm with Order-Optimal Regret Performance
(Submitted on 27 Oct 2020 (v1), last revised 29 Oct 2021 (this version, v3))
Abstract: We consider sequential optimization of an unknown function in a reproducing kernel Hilbert space. We propose a Gaussian process-based algorithm and establish its order-optimal regret performance (up to a poly-logarithmic factor). This is the first GP-based algorithm with an order-optimal regret guarantee. The proposed algorithm is rooted in the methodology of domain shrinking realized through a sequence of tree-based region pruning and refining to concentrate queries in increasingly smaller high-performing regions of the function domain. The search for high-performing regions is localized and guided by an iterative estimation of the optimal function value to ensure both learning efficiency and computational efficiency. Compared with the prevailing GP-UCB family of algorithms, the proposed algorithm reduces computational complexity by a factor of $O(T^{2d-1})$ (where $T$ is the time horizon and $d$ the dimension of the function domain).
Submission history
From: Sudeep Salgia [view email][v1] Tue, 27 Oct 2020 02:15:15 GMT (148kb,D)
[v2] Wed, 10 Feb 2021 22:37:31 GMT (351kb,D)
[v3] Fri, 29 Oct 2021 15:42:08 GMT (597kb,D)
Link back to: arXiv, form interface, contact.