We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Riemannian Manifold Optimization for Discriminant Subspace Learning

Abstract: Linear discriminant analysis (LDA) is a widely used algorithm in machine learning to extract a low-dimensional representation of high-dimensional data, it features to find the orthogonal discriminant projection subspace by using the Fisher discriminant criterion. However, the traditional Euclidean-based methods for solving LDA are easily convergent to spurious local minima and hardly obtain an optimal solution. To address such a problem, in this paper, we propose a novel algorithm namely Riemannian-based discriminant analysis (RDA) for subspace learning. In order to obtain an explicit solution, we transform the traditional Euclidean-based methods to the Riemannian manifold space and use the trust-region method to learn the discriminant projection subspace. We compare the proposed algorithm to existing variants of LDA, as well as the unsupervised tensor decomposition methods on image classification tasks. The numerical results suggest that RDA achieves state-of-the-art performance in classification accuracy.
Comments: 13 pages, 4 figures, 6 tables
Subjects: Machine Learning (cs.LG); Image and Video Processing (eess.IV); Signal Processing (eess.SP)
Cite as: arXiv:2101.08032 [cs.LG]
  (or arXiv:2101.08032v3 [cs.LG] for this version)

Submission history

From: Wanguang Yin [view email]
[v1] Wed, 20 Jan 2021 09:13:34 GMT (1513kb,D)
[v2] Tue, 26 Jan 2021 07:17:29 GMT (1489kb,D)
[v3] Tue, 20 Jul 2021 02:37:14 GMT (1492kb,D)

Link back to: arXiv, form interface, contact.