References & Citations
Computer Science > Machine Learning
Title: Neural Stochastic PDEs: Resolution-Invariant Learning of Continuous Spatiotemporal Dynamics
(Submitted on 19 Oct 2021 (v1), last revised 24 Sep 2022 (this version, v8))
Abstract: Stochastic partial differential equations (SPDEs) are the mathematical tool of choice for modelling spatiotemporal PDE-dynamics under the influence of randomness. Based on the notion of mild solution of an SPDE, we introduce a novel neural architecture to learn solution operators of PDEs with (possibly stochastic) forcing from partially observed data. The proposed Neural SPDE model provides an extension to two popular classes of physics-inspired architectures. On the one hand, it extends Neural CDEs and variants -- continuous-time analogues of RNNs -- in that it is capable of processing incoming sequential information arriving at arbitrary spatial resolutions. On the other hand, it extends Neural Operators -- generalizations of neural networks to model mappings between spaces of functions -- in that it can parameterize solution operators of SPDEs depending simultaneously on the initial condition and a realization of the driving noise. By performing operations in the spectral domain, we show how a Neural SPDE can be evaluated in two ways, either by calling an ODE solver (emulating a spectral Galerkin scheme), or by solving a fixed point problem. Experiments on various semilinear SPDEs, including the stochastic Navier-Stokes equations, demonstrate how the Neural SPDE model is capable of learning complex spatiotemporal dynamics in a resolution-invariant way, with better accuracy and lighter training data requirements compared to alternative models, and up to 3 orders of magnitude faster than traditional solvers.
Submission history
From: Cristopher Salvi [view email][v1] Tue, 19 Oct 2021 20:35:37 GMT (3738kb,D)
[v2] Wed, 1 Dec 2021 17:17:38 GMT (3744kb,D)
[v3] Tue, 21 Dec 2021 18:53:32 GMT (3745kb,D)
[v4] Fri, 28 Jan 2022 07:59:35 GMT (5586kb,D)
[v5] Tue, 19 Apr 2022 13:40:57 GMT (5601kb,D)
[v6] Sat, 21 May 2022 09:11:59 GMT (5606kb,D)
[v7] Tue, 2 Aug 2022 11:26:31 GMT (6081kb,D)
[v8] Sat, 24 Sep 2022 09:34:06 GMT (6068kb,D)
Link back to: arXiv, form interface, contact.