We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Beyond the Mean-Field: Structured Deep Gaussian Processes Improve the Predictive Uncertainties

Abstract: Deep Gaussian Processes learn probabilistic data representations for supervised learning by cascading multiple Gaussian Processes. While this model family promises flexible predictive distributions, exact inference is not tractable. Approximate inference techniques trade off the ability to closely resemble the posterior distribution against speed of convergence and computational efficiency. We propose a novel Gaussian variational family that allows for retaining covariances between latent processes while achieving fast convergence by marginalising out all global latent variables. After providing a proof of how this marginalisation can be done for general covariances, we restrict them to the ones we empirically found to be most important in order to also achieve computational efficiency. We provide an efficient implementation of our new approach and apply it to several regression benchmark datasets. We find that it yields more accurate predictive distributions, in particular for test data points that are distant from the training set.
Comments: 11 pages main text, 15 pages appendix
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)
Cite as: arXiv:2005.11110 [stat.ML]
  (or arXiv:2005.11110v1 [stat.ML] for this version)

Submission history

From: Jakob Lindinger [view email]
[v1] Fri, 22 May 2020 11:10:59 GMT (3687kb,D)

Link back to: arXiv, form interface, contact.