We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Information Theory

Title: Arıkan meets Shannon: Polar codes with near-optimal convergence to channel capacity

Abstract: Let $W$ be a binary-input memoryless symmetric (BMS) channel with Shannon capacity $I(W)$ and fix any $\alpha > 0$. We construct, for any sufficiently small $\delta > 0$, binary linear codes of block length $O(1/\delta^{2+\alpha})$ and rate $I(W)-\delta$ that enable reliable communication on $W$ with quasi-linear time encoding and decoding. Shannon's noisy coding theorem established the \emph{existence} of such codes (without efficient constructions or decoding) with block length $O(1/\delta^2)$. This quadratic dependence on the gap $\delta$ to capacity is known to be best possible. Our result thus yields a constructive version of Shannon's theorem with near-optimal convergence to capacity as a function of the block length. This resolves a central theoretical challenge associated with the attainment of Shannon capacity. Previously such a result was only known for the erasure channel.
Our codes are a variant of Ar{\i}kan's polar codes based on multiple carefully constructed local kernels, one for each intermediate channel that arises in the decoding. A crucial ingredient in the analysis is a strong converse of the noisy coding theorem when communicating using random linear codes on arbitrary BMS channels. Our converse theorem shows extreme unpredictability of even a single message bit for random coding at rates slightly above capacity.
Subjects: Information Theory (cs.IT); Computational Complexity (cs.CC); Data Structures and Algorithms (cs.DS)
Cite as: arXiv:1911.03858 [cs.IT]
  (or arXiv:1911.03858v3 [cs.IT] for this version)

Submission history

From: Andrii Riazanov [view email]
[v1] Sun, 10 Nov 2019 05:45:33 GMT (76kb)
[v2] Tue, 28 Jul 2020 20:51:11 GMT (89kb)
[v3] Mon, 24 Jan 2022 16:32:20 GMT (85kb)

Link back to: arXiv, form interface, contact.