References & Citations
Statistics > Machine Learning
Title: Multivariate Gaussian and Student$-t$ Process Regression for Multi-output Prediction
(Submitted on 13 Mar 2017 (v1), last revised 6 Jan 2019 (this version, v6))
Abstract: Gaussian process model for vector-valued function has been shown to be useful for multi-output prediction. The existing method for this model is to re-formulate the matrix-variate Gaussian distribution as a multivariate normal distribution. Although it is effective in many cases, re-formulation is not always workable and is difficult to apply to other distributions because not all matrix-variate distributions can be transformed to respective multivariate distributions, such as the case for matrix-variate Student$-t$ distribution. In this paper, we propose a unified framework which is used not only to introduce a novel multivariate Student$-t$ process regression model (MV-TPR) for multi-output prediction, but also to reformulate the multivariate Gaussian process regression (MV-GPR) that overcomes some limitations of the existing methods. Both MV-GPR and MV-TPR have closed-form expressions for the marginal likelihoods and predictive distributions under this unified framework and thus can adopt the same optimization approaches as used in the conventional GPR. The usefulness of the proposed methods is illustrated through several simulated and real data examples. In particular, we verify empirically that MV-TPR has superiority for the datasets considered, including air quality prediction and bike rent prediction. At last, the proposed methods are shown to produce profitable investment strategies in the stock markets.
Submission history
From: Zexun Chen [view email][v1] Mon, 13 Mar 2017 15:43:00 GMT (1674kb,D)
[v2] Tue, 23 May 2017 17:37:03 GMT (3378kb,D)
[v3] Mon, 17 Jul 2017 16:02:48 GMT (1342kb,D)
[v4] Wed, 4 Oct 2017 15:21:43 GMT (1343kb,D)
[v5] Thu, 18 Jan 2018 16:59:36 GMT (353kb,D)
[v6] Sun, 6 Jan 2019 20:20:05 GMT (490kb)
Link back to: arXiv, form interface, contact.