We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Multi-Objective Bayesian Optimization over High-Dimensional Search Spaces

Abstract: Many real world scientific and industrial applications require optimizing multiple competing black-box objectives. When the objectives are expensive-to-evaluate, multi-objective Bayesian optimization (BO) is a popular approach because of its high sample efficiency. However, even with recent methodological advances, most existing multi-objective BO methods perform poorly on search spaces with more than a few dozen parameters and rely on global surrogate models that scale cubically with the number of observations. In this work we propose MORBO, a scalable method for multi-objective BO over high-dimensional search spaces. MORBO identifies diverse globally optimal solutions by performing BO in multiple local regions of the design space in parallel using a coordinated strategy. We show that MORBO significantly advances the state-of-the-art in sample efficiency for several high-dimensional synthetic problems and real world applications, including an optical display design problem and a vehicle design problem with 146 and 222 parameters, respectively. On these problems, where existing BO algorithms fail to scale and perform well, MORBO provides practitioners with order-of-magnitude improvements in sample efficiency over the current approach.
Comments: To appear at UAI 2022. 24 pages
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Optimization and Control (math.OC); Machine Learning (stat.ML)
Cite as: arXiv:2109.10964 [cs.LG]
  (or arXiv:2109.10964v4 [cs.LG] for this version)

Submission history

From: Samuel Daulton [view email]
[v1] Wed, 22 Sep 2021 18:30:07 GMT (1430kb,D)
[v2] Fri, 22 Oct 2021 17:55:42 GMT (815kb,D)
[v3] Mon, 25 Oct 2021 17:58:53 GMT (815kb,D)
[v4] Wed, 15 Jun 2022 21:03:12 GMT (635kb,D)

Link back to: arXiv, form interface, contact.