We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Theory

Title: An Integral Representation of the Logarithmic Function with Applications in Information Theory

Abstract: We explore a well-known integral representation of the logarithmic function, and demonstrate its usefulness in obtaining compact, easily-computable exact formulas for quantities that involve expectations and higher moments of the logarithm of a positive random variable (or the logarithm of a sum of positive random variables). The integral representation of the logarithm is proved useful in a variety of information-theoretic applications, including universal lossless data compression, entropy and differential entropy evaluations, and the calculation of the ergodic capacity of the single-input, multiple-output (SIMO) Gaussian channel with random parameters (known to both transmitter and receiver). This integral representation and its variants are anticipated to serve as a useful tool in additional applications, as a rigorous alternative to the popular (but non-rigorous) replica method (at least in some situations).
Comments: Published in the Entropy journal, vol.22, no.1, paper 51, pp. 1--23, January 2020. See this https URL
Subjects: Information Theory (cs.IT); Probability (math.PR)
Cite as: arXiv:1912.05812 [cs.IT]
  (or arXiv:1912.05812v2 [cs.IT] for this version)

Submission history

From: Igal Sason [view email]
[v1] Thu, 12 Dec 2019 07:49:05 GMT (118kb,D)
[v2] Wed, 1 Jan 2020 08:54:42 GMT (118kb,D)

Link back to: arXiv, form interface, contact.