Current browse context:
math.PR
Change to browse by:
References & Citations
Mathematics > Probability
Title: Sharp variance-entropy comparison for nonnegative Gaussian quadratic forms
(Submitted on 24 May 2020 (v1), last revised 10 May 2021 (this version, v4))
Abstract: In this article we study weighted sums of $n$ i.i.d. Gamma($\alpha$) random variables with nonnegative weights. We show that for $n \geq 1/\alpha$ the sum with equal coefficients maximizes differential entropy when variance is fixed. As a consequence, we prove that among nonnegative quadratic forms in $n$ independent standard Gaussian random variables, a diagonal form with equal coefficients maximizes differential entropy, under a fixed variance. This provides a sharp lower bound for the relative entropy between a nonnegative quadratic form and a Gaussian random variable. Bounds on capacities of transmission channels subject to $n$ independent additive gamma noises are also derived.
Submission history
From: Szymon Zwara [view email][v1] Sun, 24 May 2020 09:59:58 GMT (16kb)
[v2] Fri, 26 Jun 2020 09:32:47 GMT (14kb)
[v3] Sat, 20 Mar 2021 14:10:14 GMT (15kb)
[v4] Mon, 10 May 2021 19:16:23 GMT (25kb)
Link back to: arXiv, form interface, contact.