Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Bit-Swap: Recursive Bits-Back Coding for Lossless Compression with Hierarchical Latent Variables
(Submitted on 16 May 2019 (v1), last revised 2 Oct 2019 (this version, v4))
Abstract: The bits-back argument suggests that latent variable models can be turned into lossless compression schemes. Translating the bits-back argument into efficient and practical lossless compression schemes for general latent variable models, however, is still an open problem. Bits-Back with Asymmetric Numeral Systems (BB-ANS), recently proposed by Townsend et al. (2019), makes bits-back coding practically feasible for latent variable models with one latent layer, but it is inefficient for hierarchical latent variable models. In this paper we propose Bit-Swap, a new compression scheme that generalizes BB-ANS and achieves strictly better compression rates for hierarchical latent variable models with Markov chain structure. Through experiments we verify that Bit-Swap results in lossless compression rates that are empirically superior to existing techniques. Our implementation is available at this https URL
Submission history
From: Friso H. Kingma [view email][v1] Thu, 16 May 2019 15:32:35 GMT (2544kb,D)
[v2] Wed, 5 Jun 2019 17:10:45 GMT (2545kb,D)
[v3] Mon, 10 Jun 2019 05:51:17 GMT (2545kb,D)
[v4] Wed, 2 Oct 2019 09:57:24 GMT (2575kb,D)
Link back to: arXiv, form interface, contact.