Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: GP-ConvCNP: Better Generalization for Convolutional Conditional Neural Processes on Time Series Data
(Submitted on 9 Jun 2021 (v1), last revised 11 Jun 2021 (this version, v2))
Abstract: Neural Processes (NPs) are a family of conditional generative models that are able to model a distribution over functions, in a way that allows them to perform predictions at test time conditioned on a number of context points. A recent addition to this family, Convolutional Conditional Neural Processes (ConvCNP), have shown remarkable improvement in performance over prior art, but we find that they sometimes struggle to generalize when applied to time series data. In particular, they are not robust to distribution shifts and fail to extrapolate observed patterns into the future. By incorporating a Gaussian Process into the model, we are able to remedy this and at the same time improve performance within distribution. As an added benefit, the Gaussian Process reintroduces the possibility to sample from the model, a key feature of other members in the NP family.
Submission history
From: Jens Petersen [view email][v1] Wed, 9 Jun 2021 10:26:39 GMT (2242kb,D)
[v2] Fri, 11 Jun 2021 13:46:13 GMT (2373kb,D)
Link back to: arXiv, form interface, contact.