Current browse context:
stat
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Positive semi-definite embedding for dimensionality reduction and out-of-sample extensions
(Submitted on 20 Nov 2017 (v1), last revised 27 Nov 2021 (this version, v4))
Abstract: In machine learning or statistics, it is often desirable to reduce the dimensionality of a sample of data points in a high dimensional space $\mathbb{R}^d$. This paper introduces a dimensionality reduction method where the embedding coordinates are the eigenvectors of a positive semi-definite kernel obtained as the solution of an infinite dimensional analogue of a semi-definite program. This embedding is adaptive and non-linear. We discuss this problem both with weak and strong smoothness assumptions about the learned kernel. A main feature of our approach is the existence of an out-of-sample extension formula of the embedding coordinates in both cases. This extrapolation formula yields an extension of the kernel matrix to a data-dependent Mercer kernel function. Our empirical results indicate that this embedding method is more robust with respect to the influence of outliers, compared with a spectral embedding method.
Submission history
From: Michaël Fanuel [view email][v1] Mon, 20 Nov 2017 12:04:37 GMT (1677kb,D)
[v2] Tue, 21 Nov 2017 10:02:09 GMT (1677kb,D)
[v3] Tue, 6 Oct 2020 13:15:06 GMT (840kb,D)
[v4] Sat, 27 Nov 2021 16:05:47 GMT (1860kb,D)
Link back to: arXiv, form interface, contact.