Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Scalable Gradients for Stochastic Differential Equations
(Submitted on 5 Jan 2020 (v1), last revised 18 Oct 2020 (this version, v6))
Abstract: The adjoint sensitivity method scalably computes gradients of solutions to ordinary differential equations. We generalize this method to stochastic differential equations, allowing time-efficient and constant-memory computation of gradients with high-order adaptive solvers. Specifically, we derive a stochastic differential equation whose solution is the gradient, a memory-efficient algorithm for caching noise, and conditions under which numerical solutions converge. In addition, we combine our method with gradient-based stochastic variational inference for latent stochastic differential equations. We use our method to fit stochastic dynamics defined by neural networks, achieving competitive performance on a 50-dimensional motion capture dataset.
Submission history
From: Xuechen Li [view email][v1] Sun, 5 Jan 2020 23:05:55 GMT (775kb,D)
[v2] Tue, 7 Jan 2020 07:00:00 GMT (2068kb,D)
[v3] Wed, 8 Jan 2020 18:15:19 GMT (2068kb,D)
[v4] Mon, 24 Feb 2020 17:27:17 GMT (2076kb,D)
[v5] Tue, 7 Jul 2020 05:40:07 GMT (2057kb,D)
[v6] Sun, 18 Oct 2020 21:16:05 GMT (2058kb,D)
Link back to: arXiv, form interface, contact.