We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

physics.chem-ph

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Physics > Chemical Physics

Title: Efficient hyperparameter tuning for kernel ridge regression with Bayesian optimization

Abstract: Machine learning methods usually depend on internal parameters -- so called hyperparameters -- that need to be optimized for best performance. Such optimization poses a burden on machine learning practitioners, requiring expert knowledge, intuition or computationally demanding brute-force parameter searches. We here address the need for more efficient, automated hyperparameter selection with Bayesian optimization. We apply this technique to the kernel ridge regression machine learning method for two different descriptors for the atomic structure of organic molecules, one of which introduces its own set of hyperparameters to the method. We identify optimal hyperparameter configurations and infer entire prediction error landscapes in hyperparameter space, that serve as visual guides for the hyperparameter dependence. We further demonstrate that for an increasing number of hyperparameters, Bayesian optimization becomes significantly more efficient in computational time than an exhaustive grid search -- the current default standard hyperparameter search method -- while delivering an equivalent or even better accuracy.
Subjects: Chemical Physics (physics.chem-ph); Computational Physics (physics.comp-ph)
Cite as: arXiv:2004.00675 [physics.chem-ph]
  (or arXiv:2004.00675v1 [physics.chem-ph] for this version)

Submission history

From: Annika Stuke [view email]
[v1] Wed, 1 Apr 2020 19:40:49 GMT (6295kb,D)

Link back to: arXiv, form interface, contact.