We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Information Theory

Title: Pruning Neural Belief Propagation Decoders

Abstract: We consider near maximum-likelihood (ML) decoding of short linear block codes based on neural belief propagation (BP) decoding recently introduced by Nachmani et al.. While this method significantly outperforms conventional BP decoding, the underlying parity-check matrix may still limit the overall performance. In this paper, we introduce a method to tailor an overcomplete parity-check matrix to (neural) BP decoding using machine learning. We consider the weights in the Tanner graph as an indication of the importance of the connected check nodes (CNs) to decoding and use them to prune unimportant CNs. As the pruning is not tied over iterations, the final decoder uses a different parity-check matrix in each iteration. For Reed-Muller and short low-density parity-check codes, we achieve performance within 0.27 dB and 1.5 dB of the ML performance while reducing the complexity of the decoder.
Comments: This work was presented at the IEEE International Symposium on Information Theory (ISIT) 2020
Subjects: Information Theory (cs.IT); Machine Learning (cs.LG)
Cite as: arXiv:2001.07464 [cs.IT]
  (or arXiv:2001.07464v2 [cs.IT] for this version)

Submission history

From: Andreas Buchberger [view email]
[v1] Tue, 21 Jan 2020 12:05:46 GMT (355kb,D)
[v2] Thu, 22 Oct 2020 18:40:04 GMT (391kb,D)

Link back to: arXiv, form interface, contact.