We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Information Theory

Title: On a generalization of the Jensen-Shannon divergence

Authors: Frank Nielsen
Abstract: The Jensen-Shannon divergence is a renown bounded symmetrization of the Kullback-Leibler divergence which does not require probability densities to have matching supports. In this paper, we introduce a vector-skew generalization of the scalar $\alpha$-Jensen-Bregman divergences and derive thereof the vector-skew $\alpha$-Jensen-Shannon divergences. We study the properties of these novel divergences and show how to build parametric families of symmetric Jensen-Shannon-type divergences. Finally, we report an iterative algorithm to numerically compute the Jensen-Shannon-type centroids for a set of probability densities belonging to a mixture family: This includes the case of the Jensen-Shannon centroid of a set of categorical distributions or normalized histograms.
Comments: 19 pages, 3 figures
Subjects: Information Theory (cs.IT); Statistics Theory (math.ST)
Journal reference: Entropy 2020, 22(2), 221
DOI: 10.3390/e22020221
Cite as: arXiv:1912.00610 [cs.IT]
  (or arXiv:1912.00610v3 [cs.IT] for this version)

Submission history

From: Frank Nielsen [view email]
[v1] Mon, 2 Dec 2019 07:41:30 GMT (62kb,D)
[v2] Tue, 3 Dec 2019 11:31:59 GMT (65kb,D)
[v3] Thu, 19 Dec 2019 07:58:15 GMT (704kb,D)

Link back to: arXiv, form interface, contact.