Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Fundamental limits for learning hidden Markov model parameters
(Submitted on 24 Jun 2021 (v1), last revised 24 Oct 2022 (this version, v3))
Abstract: We study the frontier between learnable and unlearnable hidden Markov models (HMMs). HMMs are flexible tools for clustering dependent data coming from unknown populations. The model parameters are known to be fully identifiable (up to label-switching) without any modeling assumption on the distributions of the populations as soon as the clusters are distinct and the hidden chain is ergodic with a full rank transition matrix. In the limit as any one of these conditions fails, it becomes impossible in general to identify parameters. For a chain with two hidden states we prove nonasymptotic minimax upper and lower bounds, matching up to constants, which exhibit thresholds at which the parameters become learnable. We also provide an upper bound on the relative entropy rate for parameters in a neighbourhood of the unlearnable region which may have interest in itself.
Submission history
From: Kweku Abraham [view email][v1] Thu, 24 Jun 2021 12:02:33 GMT (35kb)
[v2] Tue, 12 Oct 2021 09:29:04 GMT (37kb)
[v3] Mon, 24 Oct 2022 16:06:50 GMT (41kb)
Link back to: arXiv, form interface, contact.