We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Unsupervisedly Learned Representations: Should the Quest be Over?

Authors: Daniel N. Nissani (Nissensohn)
Abstract: There exists a Classification accuracy gap of about 20% between our best methods of generating Unsupervisedly Learned Representations and the accuracy rates achieved by (naturally Unsupervisedly Learning) humans. We are at our fourth decade at least in search of this class of paradigms. It thus may well be that we are looking in the wrong direction. We present in this paper a possible solution to this puzzle. We demonstrate that Reinforcement Learning schemes can learn representations, which may be used for Pattern Recognition tasks such as Classification, achieving practically the same accuracy as that of humans. Our main modest contribution lies in the observations that: a. when applied to a real world environment (e.g. nature itself) Reinforcement Learning does not require labels, and thus may be considered a natural candidate for the long sought, accuracy competitive Unsupervised Learning method, and b. in contrast, when Reinforcement Learning is applied in a simulated or symbolic processing environment (e.g. a computer program) it does inherently require labels and should thus be generally classified, with some exceptions, as Supervised Learning. The corollary of these observations is that further search for Unsupervised Learning competitive paradigms which may be trained in simulated environments like many of those found in research and applications may be futile.
Comments: To be published at The 6th International Conference on Machine Learning, Optimization and Data Science - LOD 2020
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)
Cite as: arXiv:2001.07495 [cs.LG]
  (or arXiv:2001.07495v3 [cs.LG] for this version)

Submission history

From: Daniel Nissani [view email]
[v1] Tue, 21 Jan 2020 13:05:31 GMT (503kb)
[v2] Mon, 9 Mar 2020 07:52:59 GMT (502kb)
[v3] Sun, 26 Jul 2020 08:14:00 GMT (522kb)

Link back to: arXiv, form interface, contact.