References & Citations
Statistics > Machine Learning
Title: Embarrassingly Parallel Inference for Gaussian Processes
(Submitted on 27 Feb 2017 (v1), last revised 3 Mar 2020 (this version, v9))
Abstract: Training Gaussian process-based models typically involves an $ O(N^3)$ computational bottleneck due to inverting the covariance matrix. Popular methods for overcoming this matrix inversion problem cannot adequately model all types of latent functions, and are often not parallelizable. However, judicious choice of model structure can ameliorate this problem. A mixture-of-experts model that uses a mixture of $K$ Gaussian processes offers modeling flexibility and opportunities for scalable inference. Our embarrassingly parallel algorithm combines low-dimensional matrix inversions with importance sampling to yield a flexible, scalable mixture-of-experts model that offers comparable performance to Gaussian process regression at a much lower computational cost.
Submission history
From: Michael Minyi Zhang [view email][v1] Mon, 27 Feb 2017 18:26:45 GMT (4588kb,D)
[v2] Fri, 23 Jun 2017 03:10:48 GMT (8868kb,D)
[v3] Sat, 10 Feb 2018 19:22:49 GMT (1266kb,D)
[v4] Wed, 14 Feb 2018 02:51:55 GMT (1266kb,D)
[v5] Wed, 13 Jun 2018 20:29:56 GMT (1686kb,D)
[v6] Thu, 11 Apr 2019 23:55:10 GMT (4576kb,D)
[v7] Mon, 15 Apr 2019 02:49:51 GMT (4576kb,D)
[v8] Sun, 17 Nov 2019 21:57:08 GMT (4953kb,D)
[v9] Tue, 3 Mar 2020 09:31:40 GMT (4957kb,D)
Link back to: arXiv, form interface, contact.