Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Long-time predictive modeling of nonlinear dynamical systems using neural networks
(Submitted on 31 May 2018 (v1), last revised 14 Nov 2018 (this version, v5))
Abstract: We study the use of feedforward neural networks (FNN) to develop models of nonlinear dynamical systems from data. Emphasis is placed on predictions at long times, with limited data availability. Inspired by global stability analysis, and the observation of the strong correlation between the local error and the maximum singular value of the Jacobian of the ANN, we introduce Jacobian regularization in the loss function. This regularization suppresses the sensitivity of the prediction to the local error and is shown to improve accuracy and robustness. Comparison between the proposed approach and sparse polynomial regression is presented in numerical examples ranging from simple ODE systems to nonlinear PDE systems including vortex shedding behind a cylinder, and instability-driven buoyant mixing flow. Furthermore, limitations of feedforward neural networks are highlighted, especially when the training data does not include a low dimensional attractor. Strategies of data augmentation are presented as remedies to address these issues to a certain extent.
Submission history
From: Shaowu Pan [view email][v1] Thu, 31 May 2018 16:36:26 GMT (5523kb,D)
[v2] Tue, 5 Jun 2018 04:02:14 GMT (5534kb,D)
[v3] Mon, 27 Aug 2018 05:35:36 GMT (6774kb,D)
[v4] Mon, 10 Sep 2018 00:06:27 GMT (6774kb,D)
[v5] Wed, 14 Nov 2018 19:55:44 GMT (6772kb,D)
Link back to: arXiv, form interface, contact.