Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Scalable Exact Inference in Multi-Output Gaussian Processes
(Submitted on 14 Nov 2019 (this version), latest version 17 Jul 2020 (v3))
Abstract: Multi-output Gaussian processes (MOGPs) leverage the flexibility and interpretability of GPs while capturing structure across outputs, which is desirable, for example, in spatio-temporal modelling. The key problem with MOGPs is the cubic computational scaling in the number of both inputs (e.g., time points or locations), n, and outputs, p. Current methods reduce this to O(n^3 m^3), where m < p is the desired degrees of freedom. This computational cost, however, is still prohibitive in many applications. To address this limitation, we present the Orthogonal Linear Mixing Model (OLMM), an MOGP in which exact inference scales linearly in m: O(n^3 m). This advance opens up a wide range of real-world tasks and can be combined with existing GP approximations in a plug-and-play way as demonstrated in the paper. Additionally, the paper organises the existing disparate literature on MOGP models into a simple taxonomy called the Mixing Model Hierarchy (MMH).
Submission history
From: Wessel Bruinsma [view email][v1] Thu, 14 Nov 2019 18:19:22 GMT (615kb,D)
[v2] Tue, 30 Jun 2020 09:29:46 GMT (1781kb,D)
[v3] Fri, 17 Jul 2020 12:10:27 GMT (1781kb,D)
Link back to: arXiv, form interface, contact.