We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Information Theory

Title: Varentropy Decreases Under the Polar Transform

Authors: Erdal Arıkan
Abstract: We consider the evolution of variance of entropy (varentropy) in the course of a polar transform operation on binary data elements (BDEs). A BDE is a pair $(X,Y)$ consisting of a binary random variable $X$ and an arbitrary side information random variable $Y$. The varentropy of $(X,Y)$ is defined as the variance of the random variable $-\log p_{X|Y}(X|Y)$. A polar transform of order two is a certain mapping that takes two independent BDEs and produces two new BDEs that are correlated with each other. It is shown that the sum of the varentropies at the output of the polar transform is less than or equal to the sum of the varentropies at the input, with equality if and only if at least one of the inputs has zero varentropy. This result is extended to polar transforms of higher orders and it is shown that the varentropy decreases to zero asymptotically when the BDEs at the input are independent and identially distributed.
Comments: Presented in part at ISIT 2014. Accepted for publication in the IEEE Trans. Inform. Theory, March 2016
Subjects: Information Theory (cs.IT)
Cite as: arXiv:1501.05005 [cs.IT]
  (or arXiv:1501.05005v3 [cs.IT] for this version)

Submission history

From: Erdal Arikan [view email]
[v1] Tue, 20 Jan 2015 22:33:24 GMT (27kb)
[v2] Mon, 16 Nov 2015 05:41:01 GMT (220kb)
[v3] Wed, 6 Apr 2016 13:02:10 GMT (218kb)

Link back to: arXiv, form interface, contact.