We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Statistics Theory

Title: Consistent order estimation for nonparametric Hidden Markov Models

Authors: Luc Lehéricy (LMO)
Abstract: We consider the problem of estimating the number of hidden states (the order) of a nonparametric hidden Markov model (HMM). We propose two different methods and prove their almost sure consistency without any prior assumption, be it on the order or on the emission distributions. This is the first time a consistency result is proved in such a general setting without using restrictive assumptions such as a priori upper bounds on the order or parametric restrictions on the emission distributions. Our main method relies on the minimization of a penalized least squares criterion. In addition to the consistency of the order estimation, we also prove that this method yields rate minimax adaptive estimators of the parameters of the HMM - up to a logarithmic factor. Our second method relies on estimating the rank of a matrix obtained from the distribution of two consecutive observations. Finally, numerical experiments are used to compare both methods and study their ability to select the right order in several situations.
Subjects: Statistics Theory (math.ST)
MSC classes: 62F07 (Primary), 62M05, 62M15, 62G05 (Secondary)
Cite as: arXiv:1606.00622 [math.ST]
  (or arXiv:1606.00622v5 [math.ST] for this version)

Submission history

From: Luc Lehéricy [view email]
[v1] Thu, 2 Jun 2016 11:09:46 GMT (217kb,D)
[v2] Tue, 13 Sep 2016 13:21:46 GMT (217kb,D)
[v3] Mon, 21 Nov 2016 15:37:43 GMT (217kb,D)
[v4] Thu, 6 Apr 2017 14:41:05 GMT (189kb,D)
[v5] Thu, 18 May 2017 15:58:03 GMT (684kb,D)

Link back to: arXiv, form interface, contact.