We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Locally induced Gaussian processes for large-scale simulation experiments

Abstract: Gaussian processes (GPs) serve as flexible surrogates for complex surfaces, but buckle under the cubic cost of matrix decompositions with big training data sizes. Geospatial and machine learning communities suggest pseudo-inputs, or inducing points, as one strategy to obtain an approximation easing that computational burden. However, we show how placement of inducing points and their multitude can be thwarted by pathologies, especially in large-scale dynamic response surface modeling tasks. As remedy, we suggest porting the inducing point idea, which is usually applied globally, over to a more local context where selection is both easier and faster. In this way, our proposed methodology hybridizes global inducing point and data subset-based local GP approximation. A cascade of strategies for planning the selection of local inducing points is provided, and comparisons are drawn to related methodology with emphasis on computer surrogate modeling applications. We show that local inducing points extend their global and data-subset component parts on the accuracy--computational efficiency frontier. Illustrative examples are provided on benchmark data and a large-scale real-simulation satellite drag interpolation problem.
Comments: 34 pages, 10 figures
Subjects: Methodology (stat.ME); Computation (stat.CO); Machine Learning (stat.ML)
Cite as: arXiv:2008.12857 [stat.ME]
  (or arXiv:2008.12857v2 [stat.ME] for this version)

Submission history

From: Austin Cole [view email]
[v1] Fri, 28 Aug 2020 21:37:46 GMT (3692kb,D)
[v2] Wed, 3 Feb 2021 20:57:43 GMT (1062kb,D)

Link back to: arXiv, form interface, contact.