We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: Spectral Mixture Kernels for Multi-Output Gaussian Processes

Abstract: Early approaches to multiple-output Gaussian processes (MOGPs) relied on linear combinations of independent, latent, single-output Gaussian processes (GPs). This resulted in cross-covariance functions with limited parametric interpretation, thus conflicting with the ability of single-output GPs to understand lengthscales, frequencies and magnitudes to name a few. On the contrary, current approaches to MOGP are able to better interpret the relationship between different channels by directly modelling the cross-covariances as a spectral mixture kernel with a phase shift. We extend this rationale and propose a parametric family of complex-valued cross-spectral densities and then build on Cram\'er's Theorem (the multivariate version of Bochner's Theorem) to provide a principled approach to design multivariate covariance functions. The so-constructed kernels are able to model delays among channels in addition to phase differences and are thus more expressive than previous methods, while also providing full parametric interpretation of the relationship across channels. The proposed method is first validated on synthetic data and then compared to existing MOGP methods on two real-world examples.
Comments: To appear in Advances in Neural Information Processing Systems 31 (NIPS 2017)
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)
Cite as: arXiv:1709.01298 [stat.ML]
  (or arXiv:1709.01298v2 [stat.ML] for this version)

Submission history

From: Felipe Tobar [view email]
[v1] Tue, 5 Sep 2017 09:20:19 GMT (2657kb,D)
[v2] Fri, 3 Nov 2017 22:44:09 GMT (805kb,D)

Link back to: arXiv, form interface, contact.