We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Theory

Title: Regenerativity of Viterbi process for pairwise Markov models

Abstract: For hidden Markov models one of the most popular estimates of the hidden chain is the Viterbi path -- the path maximising the posterior probability. We consider a more general setting, called the pairwise Markov model (PMM), where the joint process consisting of finite-state hidden process and observation process is assumed to be a Markov chain. It has been recently proven that under some conditions the Viterbi path of the PMM can almost surely be extended to infinity, thereby defining the infinite Viterbi decoding of the observation sequence, called the Viterbi process. This was done by constructing a block of observations, called a barrier, which ensures that the Viterbi path goes trough a given state whenever this block occurs in the observation sequence. In this paper we prove that the joint process consisting of Viterbi process and PMM is regenerative. The proof involves a delicate construction of regeneration times which coincide with the occurrences of barriers. As one possible application of our theory, some results on the asymptotics of the Viterbi training algorithm are derived.
Comments: arXiv admin note: substantial text overlap with arXiv:1708.03799
Subjects: Information Theory (cs.IT); Statistics Theory (math.ST); Machine Learning (stat.ML)
Journal reference: Journal of Theoretical Probability volume 34 (2021)
DOI: 10.1007/s10959-020-01022-z
Cite as: arXiv:2103.11821 [cs.IT]
  (or arXiv:2103.11821v1 [cs.IT] for this version)

Submission history

From: Joonas Sova [view email]
[v1] Mon, 15 Mar 2021 15:01:29 GMT (227kb,D)

Link back to: arXiv, form interface, contact.