Current browse context:
eess.IV
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Image and Video Processing
Title: Improving Inference for Neural Image Compression
(Submitted on 7 Jun 2020 (v1), last revised 8 Jan 2021 (this version, v4))
Abstract: We consider the problem of lossy image compression with deep latent variable models. State-of-the-art methods build on hierarchical variational autoencoders (VAEs) and learn inference networks to predict a compressible latent representation of each data point. Drawing on the variational inference perspective on compression, we identify three approximation gaps which limit performance in the conventional approach: an amortization gap, a discretization gap, and a marginalization gap. We propose remedies for each of these three limitations based on ideas related to iterative inference, stochastic annealing for discrete optimization, and bits-back coding, resulting in the first application of bits-back coding to lossy compression. In our experiments, which include extensive baseline comparisons and ablation studies, we achieve new state-of-the-art performance on lossy image compression using an established VAE architecture, by changing only the inference method.
Submission history
From: Yibo Yang [view email][v1] Sun, 7 Jun 2020 19:26:37 GMT (7040kb,D)
[v2] Tue, 9 Jun 2020 06:03:55 GMT (7039kb,D)
[v3] Tue, 6 Oct 2020 22:18:20 GMT (7352kb,D)
[v4] Fri, 8 Jan 2021 08:50:54 GMT (8177kb,D)
Link back to: arXiv, form interface, contact.