Current browse context:
math
Change to browse by:
References & Citations
Computer Science > Information Theory
Title: An Integral Representation of the Logarithmic Function with Applications in Information Theory
(Submitted on 12 Dec 2019 (v1), last revised 1 Jan 2020 (this version, v2))
Abstract: We explore a well-known integral representation of the logarithmic function, and demonstrate its usefulness in obtaining compact, easily-computable exact formulas for quantities that involve expectations and higher moments of the logarithm of a positive random variable (or the logarithm of a sum of positive random variables). The integral representation of the logarithm is proved useful in a variety of information-theoretic applications, including universal lossless data compression, entropy and differential entropy evaluations, and the calculation of the ergodic capacity of the single-input, multiple-output (SIMO) Gaussian channel with random parameters (known to both transmitter and receiver). This integral representation and its variants are anticipated to serve as a useful tool in additional applications, as a rigorous alternative to the popular (but non-rigorous) replica method (at least in some situations).
Submission history
From: Igal Sason [view email][v1] Thu, 12 Dec 2019 07:49:05 GMT (118kb,D)
[v2] Wed, 1 Jan 2020 08:54:42 GMT (118kb,D)
Link back to: arXiv, form interface, contact.