We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Regularized Classification-Aware Quantization

Abstract: Traditionally, quantization is designed to minimize the reconstruction error of a data source. When considering downstream classification tasks, other measures of distortion can be of interest; such as the 0-1 classification loss. Furthermore, it is desirable that the performance of these quantizers not deteriorate once they are deployed into production, as relearning the scheme online is not always possible. In this work, we present a class of algorithms that learn distributed quantization schemes for binary classification tasks. Our method performs well on unseen data, and is faster than previous methods proportional to a quadratic term of the dataset size. It works by regularizing the 0-1 loss with the reconstruction error. We present experiments on synthetic mixture and bivariate Gaussian data and compare training, testing, and generalization errors with a family of benchmark quantization schemes from the literature. Our method is called Regularized Classification-Aware Quantization.
Comments: Accepted to the 30th Biennial Symposium on Communications (BSC) 2021
Subjects: Machine Learning (cs.LG); Signal Processing (eess.SP)
Cite as: arXiv:2107.09716 [cs.LG]
  (or arXiv:2107.09716v1 [cs.LG] for this version)

Submission history

From: Daniel Severo [view email]
[v1] Mon, 12 Jul 2021 21:27:48 GMT (4646kb,D)

Link back to: arXiv, form interface, contact.