We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Model-assisted deep learning of rare extreme events from partial observations

Abstract: To predict rare extreme events using deep neural networks, one encounters the so-called small data problem because even long-term observations often contain few extreme events. Here, we investigate a model-assisted framework where the training data is obtained from numerical simulations, as opposed to observations, with adequate samples from extreme events. However, to ensure the trained networks are applicable in practice, the training is not performed on the full simulation data; instead we only use a small subset of observable quantities which can be measured in practice. We investigate the feasibility of this model-assisted framework on three different dynamical systems (Rossler attractor, FitzHugh-Nagumo model, and a turbulent fluid flow) and three different deep neural network architectures (feedforward, long short-term memory, and reservoir computing). In each case, we study the prediction accuracy, robustness to noise, reproducibility under repeated training, and sensitivity to the type of input data. In particular, we find long short-term memory networks to be most robust to noise and to yield relatively accurate predictions, while requiring minimal fine-tuning of the hyperparameters.
Comments: Accepted for publication in Chaos: An Interdisciplinary Journal of Nonlinear Science
Subjects: Machine Learning (cs.LG); Dynamical Systems (math.DS); Chaotic Dynamics (nlin.CD); Fluid Dynamics (physics.flu-dyn)
DOI: 10.1063/5.0077646
Cite as: arXiv:2111.04857 [cs.LG]
  (or arXiv:2111.04857v2 [cs.LG] for this version)

Submission history

From: Mohammad Farazmand [view email]
[v1] Thu, 4 Nov 2021 23:24:22 GMT (11905kb,D)
[v2] Tue, 22 Mar 2022 13:08:18 GMT (11902kb,D)

Link back to: arXiv, form interface, contact.