We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Information Theory

Title: The α-divergences associated with a pair of strictly comparable quasi-arithmetic means

Authors: Frank Nielsen
Abstract: We generalize the family of $\alpha$-divergences using a pair of strictly comparable weighted means. In particular, we obtain the $1$-divergence in the limit case $\alpha\rightarrow 1$ (a generalization of the Kullback-Leibler divergence) and the $0$-divergence in the limit case $\alpha\rightarrow 0$ (a generalization of the reverse Kullback-Leibler divergence). We state the condition for a pair of quasi-arithmetic means to be strictly comparable, and report the formula for the quasi-arithmetic $\alpha$-divergences and its subfamily of bipower homogeneous $\alpha$-divergences which belong to the Csis\'ar's $f$-divergences. Finally, we show that these generalized quasi-arithmetic $1$-divergences and $0$-divergences can be decomposed as the sum of generalized cross-entropies minus entropies, and rewritten as conformal Bregman divergences using monotone embeddings.
Comments: 18 pages
Subjects: Information Theory (cs.IT)
Journal reference: Algorithms 2022, 15(11), 435
DOI: 10.3390/a15110435
Cite as: arXiv:2001.09660 [cs.IT]
  (or arXiv:2001.09660v4 [cs.IT] for this version)

Submission history

From: Frank Nielsen [view email]
[v1] Mon, 27 Jan 2020 10:09:21 GMT (12kb)
[v2] Thu, 30 Jan 2020 03:00:16 GMT (15kb)
[v3] Wed, 5 Feb 2020 02:46:06 GMT (17kb)
[v4] Mon, 17 Feb 2020 09:23:43 GMT (20kb)

Link back to: arXiv, form interface, contact.