Current browse context:
cs.IT
Change to browse by:
References & Citations
Computer Science > Information Theory
Title: On the Rényi Divergence and the Joint Range of Relative Entropies
(Submitted on 15 Jan 2015 (v1), revised 18 Feb 2015 (this version, v2), latest version 26 Oct 2015 (v4))
Abstract: This paper starts with a study of the minimum of the R\'{e}nyi divergence subject to a fixed (or minimal) value of the total variation distance. Relying on the solution of this minimization problem, we determine the exact region of the points $\bigl( D(Q||P_1), D(Q||P_2) \bigr)$ where $P_1$ and $P_2$ are any probability distributions whose total variation distance is not below a fixed value, and the probability distribution $Q$ is arbitrary (none of these three distributions is assumed to be fixed). It is further shown that all the points of this convex region are attained by a triple of 2-element probability distributions. As a byproduct of this characterization, we provide a geometric interpretation of the minimal Chernoff information subject to a minimal total variation distance.
Submission history
From: Igal Sason [view email][v1] Thu, 15 Jan 2015 10:03:57 GMT (86kb)
[v2] Wed, 18 Feb 2015 07:22:27 GMT (87kb)
[v3] Wed, 4 Mar 2015 00:15:01 GMT (91kb)
[v4] Mon, 26 Oct 2015 13:52:57 GMT (90kb)
Link back to: arXiv, form interface, contact.