We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.CO

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Computation

Title: MuyGPs: Scalable Gaussian Process Hyperparameter Estimation Using Local Cross-Validation

Abstract: Gaussian processes (GPs) are non-linear probabilistic models popular in many applications. However, na\"ive GP realizations require quadratic memory to store the covariance matrix and cubic computation to perform inference or evaluate the likelihood function. These bottlenecks have driven much investment in the development of approximate GP alternatives that scale to the large data sizes common in modern data-driven applications. We present in this manuscript MuyGPs, a novel efficient GP hyperparameter estimation method. MuyGPs builds upon prior methods that take advantage of the nearest neighbors structure of the data, and uses leave-one-out cross-validation to optimize covariance (kernel) hyperparameters without realizing a possibly expensive likelihood. We describe our model and methods in detail, and compare our implementations against the state-of-the-art competitors in a benchmark spatial statistics problem. We show that our method outperforms all known competitors both in terms of time-to-solution and the root mean squared error of the predictions.
Comments: 15 pages, 5 figures
Subjects: Computation (stat.CO); Machine Learning (stat.ML)
Cite as: arXiv:2104.14581 [stat.CO]
  (or arXiv:2104.14581v1 [stat.CO] for this version)

Submission history

From: Amanda Muyskens [view email]
[v1] Thu, 29 Apr 2021 18:10:21 GMT (1172kb,D)

Link back to: arXiv, form interface, contact.