References & Citations
Computer Science > Information Theory
Title: The α-divergences associated with a pair of strictly comparable quasi-arithmetic means
(Submitted on 27 Jan 2020 (v1), last revised 17 Feb 2020 (this version, v4))
Abstract: We generalize the family of $\alpha$-divergences using a pair of strictly comparable weighted means. In particular, we obtain the $1$-divergence in the limit case $\alpha\rightarrow 1$ (a generalization of the Kullback-Leibler divergence) and the $0$-divergence in the limit case $\alpha\rightarrow 0$ (a generalization of the reverse Kullback-Leibler divergence). We state the condition for a pair of quasi-arithmetic means to be strictly comparable, and report the formula for the quasi-arithmetic $\alpha$-divergences and its subfamily of bipower homogeneous $\alpha$-divergences which belong to the Csis\'ar's $f$-divergences. Finally, we show that these generalized quasi-arithmetic $1$-divergences and $0$-divergences can be decomposed as the sum of generalized cross-entropies minus entropies, and rewritten as conformal Bregman divergences using monotone embeddings.
Submission history
From: Frank Nielsen [view email][v1] Mon, 27 Jan 2020 10:09:21 GMT (12kb)
[v2] Thu, 30 Jan 2020 03:00:16 GMT (15kb)
[v3] Wed, 5 Feb 2020 02:46:06 GMT (17kb)
[v4] Mon, 17 Feb 2020 09:23:43 GMT (20kb)
Link back to: arXiv, form interface, contact.