We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Probability

Title: Sharp variance-entropy comparison for nonnegative Gaussian quadratic forms

Abstract: In this article we study weighted sums of $n$ i.i.d. Gamma($\alpha$) random variables with nonnegative weights. We show that for $n \geq 1/\alpha$ the sum with equal coefficients maximizes differential entropy when variance is fixed. As a consequence, we prove that among nonnegative quadratic forms in $n$ independent standard Gaussian random variables, a diagonal form with equal coefficients maximizes differential entropy, under a fixed variance. This provides a sharp lower bound for the relative entropy between a nonnegative quadratic form and a Gaussian random variable. Bounds on capacities of transmission channels subject to $n$ independent additive gamma noises are also derived.
Subjects: Probability (math.PR); Information Theory (cs.IT)
Cite as: arXiv:2005.11705 [math.PR]
  (or arXiv:2005.11705v4 [math.PR] for this version)

Submission history

From: Szymon Zwara [view email]
[v1] Sun, 24 May 2020 09:59:58 GMT (16kb)
[v2] Fri, 26 Jun 2020 09:32:47 GMT (14kb)
[v3] Sat, 20 Mar 2021 14:10:14 GMT (15kb)
[v4] Mon, 10 May 2021 19:16:23 GMT (25kb)

Link back to: arXiv, form interface, contact.