We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Information Theory

Title: Gaussian Approximation of Quantization Error for Estimation from Compressed Data

Abstract: We consider the distributional connection between the lossy compressed representation of a high-dimensional signal $X$ using a random spherical code and the observation of $X$ under an additive white Gaussian noise (AWGN). We show that the Wasserstein distance between a bitrate-$R$ compressed version of $X$ and its observation under an AWGN-channel of signal-to-noise ratio $2^{2R}-1$ is sub-linear in the problem dimension. We utilize this fact to connect the risk of an estimator based on an AWGN-corrupted version of $X$ to the risk attained by the same estimator when fed with its bitrate-$R$ quantized version. We demonstrate the usefulness of this connection by deriving various novel results for inference problems under compression constraints, including minimax estimation, sparse regression, compressed sensing, and the universality of linear estimation in remote source coding.
Subjects: Information Theory (cs.IT); Machine Learning (stat.ML)
Journal reference: IEEE Transactions on Information Theory (Volume: 67, Issue: 8, Aug. 2021)
DOI: 10.1109/TIT.2021.3083271
Cite as: arXiv:2001.03243 [cs.IT]
  (or arXiv:2001.03243v3 [cs.IT] for this version)

Submission history

From: Alon Kipnis [view email]
[v1] Thu, 9 Jan 2020 22:10:10 GMT (382kb)
[v2] Thu, 12 Mar 2020 00:15:45 GMT (362kb)
[v3] Sun, 12 Dec 2021 06:42:10 GMT (313kb)

Link back to: arXiv, form interface, contact.