We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Theory

Title: Cramér-Rao Lower Bounds Arising from Generalized Csiszár Divergences

Abstract: We study the geometry of probability distributions with respect to a generalized family of Csisz\'ar $f$-divergences. A member of this family is the relative $\alpha$-entropy which is also a R\'enyi analog of relative entropy in information theory and known as logarithmic or projective power divergence in statistics. We apply Eguchi's theory to derive the Fisher information metric and the dual affine connections arising from these generalized divergence functions. This enables us to arrive at a more widely applicable version of the Cram\'{e}r-Rao inequality, which provides a lower bound for the variance of an estimator for an escort of the underlying parametric probability distribution. We then extend the Amari-Nagaoka's dually flat structure of the exponential and mixer models to other distributions with respect to the aforementioned generalized metric. We show that these formulations lead us to find unbiased and efficient estimators for the escort model. Finally, we compare our work with prior results on generalized Cram\'er-Rao inequalities that were derived from non-information-geometric frameworks.
Comments: 25 pages
Subjects: Information Theory (cs.IT); Signal Processing (eess.SP); Statistics Theory (math.ST); Machine Learning (stat.ML)
Cite as: arXiv:2001.04769 [cs.IT]
  (or arXiv:2001.04769v2 [cs.IT] for this version)

Submission history

From: Kumar Vijay Mishra [view email]
[v1] Tue, 14 Jan 2020 13:41:13 GMT (39kb)
[v2] Sun, 24 May 2020 05:24:23 GMT (44kb)

Link back to: arXiv, form interface, contact.