We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.NA

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Numerical Analysis

Title: Deep learning of dynamics and signal-noise decomposition with time-stepping constraints

Abstract: A critical challenge in the data-driven modeling of dynamical systems is producing methods robust to measurement error, particularly when data is limited. Many leading methods either rely on denoising prior to learning or on access to large volumes of data to average over the effect of noise. We propose a novel paradigm for data-driven modeling that simultaneously learns the dynamics and estimates the measurement noise at each observation. By constraining our learning algorithm, our method explicitly accounts for measurement error in the map between observations, treating both the measurement error and the dynamics as unknowns to be identified, rather than assuming idealized noiseless trajectories. We model the unknown vector field using a deep neural network, imposing a Runge-Kutta integrator structure to isolate this vector field, even when the data has a non-uniform timestep, thus constraining and focusing the modeling effort. We demonstrate the ability of this framework to form predictive models on a variety of canonical test problems of increasing complexity and show that it is robust to substantial amounts of measurement error. We also discuss issues with the generalizability of neural network models for dynamical systems and provide open-source code for all examples.
Comments: Updated a reference to reflect publication
Subjects: Numerical Analysis (math.NA)
DOI: 10.1016/j.jcp.2019.06.056
Cite as: arXiv:1808.02578 [math.NA]
  (or arXiv:1808.02578v2 [math.NA] for this version)

Submission history

From: Samuel Rudy [view email]
[v1] Tue, 7 Aug 2018 23:05:13 GMT (4975kb,D)
[v2] Wed, 22 Aug 2018 21:21:18 GMT (4975kb,D)

Link back to: arXiv, form interface, contact.