We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Neural Jump Ordinary Differential Equations: Consistent Continuous-Time Prediction and Filtering

Abstract: Combinations of neural ODEs with recurrent neural networks (RNN), like GRU-ODE-Bayes or ODE-RNN are well suited to model irregularly observed time series. While those models outperform existing discrete-time approaches, no theoretical guarantees for their predictive capabilities are available. Assuming that the irregularly-sampled time series data originates from a continuous stochastic process, the $L^2$-optimal online prediction is the conditional expectation given the currently available information. We introduce the Neural Jump ODE (NJ-ODE) that provides a data-driven approach to learn, continuously in time, the conditional expectation of a stochastic process. Our approach models the conditional expectation between two observations with a neural ODE and jumps whenever a new observation is made. We define a novel training framework, which allows us to prove theoretical guarantees for the first time. In particular, we show that the output of our model converges to the $L^2$-optimal prediction. This can be interpreted as solution to a special filtering problem. We provide experiments showing that the theoretical results also hold empirically. Moreover, we experimentally show that our model outperforms the baselines in more complex learning tasks and give comparisons on real-world datasets.
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR); Computational Finance (q-fin.CP); Statistical Finance (q-fin.ST)
Journal reference: International Conference on Learning Representations (2021)
Cite as: arXiv:2006.04727 [stat.ML]
  (or arXiv:2006.04727v4 [stat.ML] for this version)

Submission history

From: Florian Krach [view email]
[v1] Mon, 8 Jun 2020 16:34:51 GMT (1289kb,D)
[v2] Sat, 3 Oct 2020 06:46:28 GMT (1075kb,D)
[v3] Wed, 9 Dec 2020 13:36:20 GMT (1043kb,D)
[v4] Fri, 16 Apr 2021 12:54:38 GMT (1510kb,D)

Link back to: arXiv, form interface, contact.