We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: A Probabilistic State Space Model for Joint Inference from Differential Equations and Data

Abstract: Mechanistic models with differential equations are a key component of scientific applications of machine learning. Inference in such models is usually computationally demanding, because it involves repeatedly solving the differential equation. The main problem here is that the numerical solver is hard to combine with standard inference techniques. Recent work in probabilistic numerics has developed a new class of solvers for ordinary differential equations (ODEs) that phrase the solution process directly in terms of Bayesian filtering. We here show that this allows such methods to be combined very directly, with conceptual and numerical ease, with latent force models in the ODE itself. It then becomes possible to perform approximate Bayesian inference on the latent force as well as the ODE solution in a single, linear complexity pass of an extended Kalman filter / smoother - that is, at the cost of computing a single ODE solution. We demonstrate the expressiveness and performance of the algorithm by training, among others, a non-parametric SIRD model on data from the COVID-19 outbreak.
Comments: 12 pages (+ 5 pages appendix), 7 figures. In: Advances in Neural Information Processing Systems (NeurIPS 2021)
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)
Cite as: arXiv:2103.10153 [stat.ML]
  (or arXiv:2103.10153v3 [stat.ML] for this version)

Submission history

From: Jonathan Schmidt [view email]
[v1] Thu, 18 Mar 2021 10:36:09 GMT (526kb,D)
[v2] Mon, 21 Jun 2021 16:08:47 GMT (769kb,D)
[v3] Tue, 5 Jul 2022 10:06:30 GMT (770kb,D)

Link back to: arXiv, form interface, contact.