We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Theory

Title: Rényi Divergence in General Hidden Markov Models

Abstract: In this paper, we examine the existence of the R\'enyi divergence between two time invariant general hidden Markov models with arbitrary positive initial distributions. By making use of a Markov chain representation of the probability distribution for the general hidden Markov model and eigenvalue for the associated Markovian operator, we obtain, under some regularity conditions, convergence of the R\'enyi divergence. By using this device, we also characterize the R\'enyi divergence, and obtain the Kullback-Leibler divergence as {\alpha} \rightarrow 1 of the R\'enyi divergence. Several examples, including the classical finite state hidden Markov models, Markov switching models, and recurrent neural networks, are given for illustration. Moreover, we develop a non-Monte Carlo method that computes the R\'enyi divergence of two-state Markov switching models via the underlying invariant probability measure, which is characterized by the Fredholm integral equation.
Comments: 39 pages
Subjects: Information Theory (cs.IT)
MSC classes: ACM-class: E.4
Cite as: arXiv:2106.01645 [cs.IT]
  (or arXiv:2106.01645v1 [cs.IT] for this version)

Submission history

From: Chuan-Ju Wang [view email]
[v1] Thu, 3 Jun 2021 07:25:26 GMT (37kb)

Link back to: arXiv, form interface, contact.