We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: Convergence of a Particle-based Approximation of the Block Online Expectation Maximization Algorithm

Authors: Sylvain Le Corff (LTCI), Gersende Fort (LTCI)
Abstract: Online variants of the Expectation Maximization (EM) algorithm have recently been proposed to perform parameter inference with large data sets or data streams, in independent latent models and in hidden Markov models. Nevertheless, the convergence properties of these algorithms remain an open problem at least in the hidden Markov case. This contribution deals with a new online EM algorithm which updates the parameter at some deterministic times. Some convergence results have been derived even in general latent models such as hidden Markov models. These properties rely on the assumption that some intermediate quantities are available in closed form or can be approximated by Monte Carlo methods when the Monte Carlo error vanishes rapidly enough. In this paper, we propose an algorithm which approximates these quantities using Sequential Monte Carlo methods. The convergence of this algorithm and of an averaged version is established and their performance is illustrated through Monte Carlo experiments.
Subjects: Statistics Theory (math.ST)
Cite as: arXiv:1111.1307 [math.ST]
  (or arXiv:1111.1307v3 [math.ST] for this version)

Submission history

From: Sylvain Le Corff [view email]
[v1] Sat, 5 Nov 2011 13:49:51 GMT (99kb,D)
[v2] Fri, 24 Feb 2012 19:18:04 GMT (105kb,D)
[v3] Wed, 30 May 2012 09:16:38 GMT (106kb,D)

Link back to: arXiv, form interface, contact.