Current browse context:
stat.ME
Change to browse by:
References & Citations
Statistics > Methodology
Title: Fast calculation of Gaussian Process multiple-fold cross-validation residuals and their covariances
(Submitted on 8 Jan 2021 (v1), last revised 3 Jun 2023 (this version, v3))
Abstract: We generalize fast Gaussian process leave-one-out formulae to multiple-fold cross-validation, highlighting in turn the covariance structure of cross-validation residuals in both Simple and Universal Kriging frameworks. We illustrate how resulting covariances affect model diagnostics. We further establish in the case of noiseless observations that correcting for covariances between residuals in cross-validation-based estimation of the scale parameter leads back to MLE. Also, we highlight in broader settings how differences between pseudo-likelihood and likelihood methods boil down to accounting or not for residual covariances. The proposed fast calculation of cross-validation residuals is implemented and benchmarked against a naive implementation. Numerical experiments highlight the accuracy and substantial speed-ups that our approach enables. However, as supported by a discussion on main drivers of computational costs and by a numerical benchmark, speed-ups steeply decline as the number of folds (say, all sharing the same size) decreases. An application to a contaminant localization test case illustrates that grouping clustered observations in folds may help improving model assessment and parameter fitting compared to Leave-One-Out. Overall, our results enable fast multiple-fold cross-validation, have direct consequences in model diagnostics, and pave the way to future work on hyperparameter fitting and on the promising field of goal-oriented fold design.
Submission history
From: David Ginsbourger [view email][v1] Fri, 8 Jan 2021 17:02:37 GMT (100kb,D)
[v2] Wed, 25 May 2022 13:07:47 GMT (346kb,D)
[v3] Sat, 3 Jun 2023 09:19:57 GMT (349kb,D)
Link back to: arXiv, form interface, contact.