We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: SnAKe: Bayesian Optimization with Pathwise Exploration

Abstract: Bayesian Optimization is a very effective tool for optimizing expensive black-box functions. Inspired by applications developing and characterizing reaction chemistry using droplet microfluidic reactors, we consider a novel setting where the expense of evaluating the function can increase significantly when making large input changes between iterations. We further assume we are working asynchronously, meaning we have to select new queries before evaluating previous experiments. This paper investigates the problem and introduces 'Sequential Bayesian Optimization via Adaptive Connecting Samples' (SnAKe), which provides a solution by considering large batches of queries and preemptively building optimization paths that minimize input costs. We investigate some convergence properties and empirically show that the algorithm is able to achieve regret similar to classical Bayesian Optimization algorithms in both synchronous and asynchronous settings, while reducing input costs significantly. We show the method is robust to the choice of its single hyper-parameter and provide a parameter-free alternative.
Comments: 10 main pages, 39 with appendix, 30 figures, 10 tables. Final camera-ready version for NeurIPS, with supplementary material included
Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)
Cite as: arXiv:2202.00060 [cs.LG]
  (or arXiv:2202.00060v4 [cs.LG] for this version)

Submission history

From: Jose Pablo Folch [view email]
[v1] Mon, 31 Jan 2022 19:42:56 GMT (15153kb,D)
[v2] Wed, 16 Feb 2022 20:19:56 GMT (15119kb,D)
[v3] Tue, 4 Oct 2022 13:27:41 GMT (22233kb,D)
[v4] Wed, 11 Jan 2023 16:37:32 GMT (22237kb,D)

Link back to: arXiv, form interface, contact.