We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Efficient Learning of the Parameters of Non-Linear Models using Differentiable Resampling in Particle Filters

Abstract: It has been widely documented that the sampling and resampling steps in particle filters cannot be differentiated. The {\itshape reparameterisation trick} was introduced to allow the sampling step to be reformulated into a differentiable function. We extend the {\itshape reparameterisation trick} to include the stochastic input to resampling therefore limiting the discontinuities in the gradient calculation after this step. Knowing the gradients of the prior and likelihood allows us to run particle Markov Chain Monte Carlo (p-MCMC) and use the No-U-Turn Sampler (NUTS) as the proposal when estimating parameters.
We compare the Metropolis-adjusted Langevin algorithm (MALA), Hamiltonian Monte Carlo with different number of steps and NUTS. We consider two state-space models and show that NUTS improves the mixing of the Markov chain and can produce more accurate results in less computational time.
Comments: 35 pages, 10 figures
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)
DOI: 10.1109/TSP.2022.3187868
Cite as: arXiv:2111.01409 [stat.ML]
  (or arXiv:2111.01409v2 [stat.ML] for this version)

Submission history

From: Conor Rosato [view email]
[v1] Tue, 2 Nov 2021 08:03:09 GMT (3764kb,D)
[v2] Wed, 27 Apr 2022 10:28:46 GMT (8130kb,D)

Link back to: arXiv, form interface, contact.