We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: Revisiting Bayesian Optimization in the light of the COCO benchmark

Abstract: It is commonly believed that Bayesian optimization (BO) algorithms are highly efficient for optimizing numerically costly functions. However, BO is not often compared to widely different alternatives, and is mostly tested on narrow sets of problems (multimodal, low-dimensional functions), which makes it difficult to assess where (or if) they actually achieve state-of-the-art performance. Moreover, several aspects in the design of these algorithms vary across implementations without a clear recommendation emerging from current practices, and many of these design choices are not substantiated by authoritative test campaigns. This article reports a large investigation about the effects on the performance of (Gaussian process based) BO of common and less common design choices. The experiments are carried out with the established COCO (COmparing Continuous Optimizers) software. It is found that a small initial budget, a quadratic trend, high-quality optimization of the acquisition criterion bring consistent progress. Using the GP mean as an occasional acquisition contributes to a negligible additional improvement. Warping degrades performance. The Mat\'ern 5/2 kernel is a good default but it may be surpassed by the exponential kernel on irregular functions. Overall, the best EGO variants are competitive or improve over state-of-the-art algorithms in dimensions less or equal to 5 for multimodal functions. The code developed for this study makes the new version (v2.1.1) of the R package DiceOptim available on CRAN. The structure of the experiments by function groups allows to define priorities for future research on Bayesian optimization.
Subjects: Optimization and Control (math.OC); Computation (stat.CO); Machine Learning (stat.ML)
Journal reference: Journal of Structural and Multidisciplinary Optimization, July 2021
DOI: 10.1007/s00158-021-02977-1
Cite as: arXiv:2103.16649 [math.OC]
  (or arXiv:2103.16649v4 [math.OC] for this version)

Submission history

From: Rodolphe Le Riche [view email]
[v1] Tue, 30 Mar 2021 19:45:18 GMT (5444kb,D)
[v2] Mon, 7 Jun 2021 14:17:15 GMT (5445kb,D)
[v3] Sat, 3 Jul 2021 08:00:09 GMT (5445kb,D)
[v4] Thu, 30 Sep 2021 09:21:37 GMT (5443kb,D)

Link back to: arXiv, form interface, contact.