Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Structured Inference Networks for Nonlinear State Space Models
(Submitted on 30 Sep 2016 (v1), last revised 5 Dec 2016 (this version, v2))
Abstract: Gaussian state space models have been used for decades as generative models of sequential data. They admit an intuitive probabilistic interpretation, have a simple functional form, and enjoy widespread adoption. We introduce a unified algorithm to efficiently learn a broad class of linear and non-linear state space models, including variants where the emission and transition distributions are modeled by deep neural networks. Our learning algorithm simultaneously learns a compiled inference network and the generative model, leveraging a structured variational approximation parameterized by recurrent neural networks to mimic the posterior distribution. We apply the learning algorithm to both synthetic and real-world datasets, demonstrating its scalability and versatility. We find that using the structured approximation to the posterior results in models with significantly higher held-out likelihood.
Submission history
From: Rahul Gopal Krishnan [view email][v1] Fri, 30 Sep 2016 19:53:11 GMT (2875kb,D)
[v2] Mon, 5 Dec 2016 19:10:10 GMT (996kb,D)
Link back to: arXiv, form interface, contact.