We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Semi-Supervised Representation Learning based on Probabilistic Labeling

Abstract: In this paper, we present a new algorithm for semi-supervised representation learning. In this algorithm, we first find a vector representation for the labels of the data points based on their local positions in the space. Then, we map the data to lower-dimensional space using a linear transformation such that the dependency between the transformed data and the assigned labels is maximized. In fact, we try to find a mapping that is as discriminative as possible. The approach will use Hilber-Schmidt Independence Criterion (HSIC) as the dependence measure. We also present a kernelized version of the algorithm, which allows non-linear transformations and provides more flexibility in finding the appropriate mapping. Use of unlabeled data for learning new representation is not always beneficial and there is no algorithm that can deterministically guarantee the improvement of the performance by exploiting unlabeled data. Therefore, we also propose a bound on the performance of the algorithm, which can be used to determine the effectiveness of using the unlabeled data in the algorithm. We demonstrate the ability of the algorithm in finding the transformation using both toy examples and real-world datasets.
Comments: 8 pages, 7 figures
Subjects: Machine Learning (cs.LG)
Cite as: arXiv:1605.03072 [cs.LG]
  (or arXiv:1605.03072v3 [cs.LG] for this version)

Submission history

From: Ershad Banijamali Mr. [view email]
[v1] Tue, 10 May 2016 15:57:18 GMT (218kb)
[v2] Mon, 22 Aug 2016 21:27:06 GMT (218kb)
[v3] Thu, 15 Sep 2016 19:44:51 GMT (211kb,D)
[v4] Tue, 4 Aug 2020 04:40:02 GMT (186kb,D)

Link back to: arXiv, form interface, contact.