We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: The Canonical Distortion Measure for Vector Quantization and Function Approximation

Abstract: To measure the quality of a set of vector quantization points a means of measuring the distance between a random point and its quantization is required. Common metrics such as the {\em Hamming} and {\em Euclidean} metrics, while mathematically simple, are inappropriate for comparing natural signals such as speech or images. In this paper it is shown how an {\em environment} of functions on an input space $X$ induces a {\em canonical distortion measure} (CDM) on X. The depiction 'canonical" is justified because it is shown that optimizing the reconstruction error of X with respect to the CDM gives rise to optimal piecewise constant approximations of the functions in the environment. The CDM is calculated in closed form for several different function classes. An algorithm for training neural networks to implement the CDM is presented along with some encouraging experimental results.
Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)
Journal reference: In: Thrun S., Pratt L. (eds) Learning to Learn (1998). Pages 159-177
DOI: 10.1007/978-1-4615-5529-2_7
Cite as: arXiv:1911.06319 [cs.LG]
  (or arXiv:1911.06319v1 [cs.LG] for this version)

Submission history

From: Jonathan Baxter [view email]
[v1] Thu, 14 Nov 2019 18:59:38 GMT (49kb)

Link back to: arXiv, form interface, contact.