We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Theory

Title: Sharp moment-entropy inequalities and capacity bounds for log-concave distributions

Abstract: We show that the uniform distribution minimizes entropy among all one-dimensional symmetric log-concave distributions with fixed variance, as well as various generalizations of this fact to R\'enyi entropies of orders less than 1 and with moment constraints involving $p$-th absolute moments with $p\leq 2$. As consequences, we give new capacity bounds for additive noise channels with symmetric log-concave noises, as well as for timing channels involving positive signal and noise where the noise has a decreasing log-concave density. In particular, we show that the capacity of an additive noise channel with symmetric, log-concave noise under an average power constraint is at most 0.254 bits per channel use greater than the capacity of an additive Gaussian noise channel with the same noise power. Consequences for reverse entropy power inequalities and connections to the slicing problem in convex geometry are also discussed.
Comments: the original paper split into two: this one and arXiv:1904.02314; additional results added to this part
Subjects: Information Theory (cs.IT); Probability (math.PR)
MSC classes: 94A17 (Primary), 60E15 (Secondary)
Journal reference: IEEE Trans. Inform. Theory, vol. 67, no. 1, pp. 81-94, 2021
DOI: 10.1109/TIT.2020.3032371
Cite as: arXiv:1811.00345 [cs.IT]
  (or arXiv:1811.00345v4 [cs.IT] for this version)

Submission history

From: Tomasz Tkocz [view email]
[v1] Thu, 1 Nov 2018 12:45:40 GMT (16kb)
[v2] Fri, 5 Apr 2019 01:35:51 GMT (28kb)
[v3] Tue, 5 May 2020 02:40:02 GMT (30kb)
[v4] Tue, 13 Oct 2020 01:37:12 GMT (32kb)

Link back to: arXiv, form interface, contact.