We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Theory

Title: An Elementary Proof of a Classical Information-Theoretic Formula

Abstract: A renowned information-theoretic formula by Shannon expresses the mutual information rate of a white Gaussian channel with a stationary Gaussian input as an integral of a simple function of the power spectral density of the channel input. We give in this paper a rigorous yet elementary proof of this classical formula. As opposed to all the conventional approaches, which either rely on heavy mathematical machineries or have to resort to some "external" results, our proof, which hinges on a recently proven sampling theorem, is elementary and self-contained, only using some well-known facts from basic calculus and matrix theory.
Subjects: Information Theory (cs.IT)
Cite as: arXiv:1809.01422 [cs.IT]
  (or arXiv:1809.01422v2 [cs.IT] for this version)

Submission history

From: Guangyue Han [view email]
[v1] Wed, 5 Sep 2018 10:28:23 GMT (9kb)
[v2] Sat, 20 Oct 2018 00:56:59 GMT (10kb)

Link back to: arXiv, form interface, contact.