We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: A universal framework for learning based on the elliptical mixture model (EMM)

Abstract: An increasing prominence of unbalanced and noisy data highlights the importance of elliptical mixture models (EMMs), which exhibit enhanced robustness, flexibility and stability over the widely applied Gaussian mixture model (GMM). However, existing studies of the EMM are typically of \textit{ad hoc} nature, without a universal analysis framework or existence and uniqueness considerations. To this end, we propose a general framework for estimating the EMM, which makes use of the Riemannian manifold optimisation to convert the original constrained optimisation paradigms into an un-constrained one. We first revisit the statistics of elliptical distributions, to give a rationale for the use of Riemannian metrics as well as the reformulation of the problem in the Riemannian space. We then derive the EMM learning framework, based on Riemannian gradient descent, which ensures the same optimum as the original problem but accelerates the convergence speed. We also unify the treatment of the existing elliptical distributions to build a universal EMM, providing a simple and intuitive way to deal with the non-convex nature of this optimisation problem. Numerical results demonstrate the ability of the proposed framework to accommodate EMMs with different properties of individual functions, and also verify the robustness and flexibility of the proposed framework over the standard GMM.
Subjects: Machine Learning (cs.LG); Signal Processing (eess.SP); Machine Learning (stat.ML)
Cite as: arXiv:1805.08045 [cs.LG]
  (or arXiv:1805.08045v1 [cs.LG] for this version)

Submission history

From: Shengxi Li [view email]
[v1] Mon, 21 May 2018 13:39:22 GMT (121kb,D)
[v2] Tue, 29 May 2018 11:16:32 GMT (121kb,D)
[v3] Sun, 9 Jun 2019 20:09:50 GMT (3550kb,D)
[v4] Sun, 12 Jan 2020 13:45:46 GMT (3864kb,D)
[v5] Mon, 28 Sep 2020 22:13:07 GMT (2790kb,D)

Link back to: arXiv, form interface, contact.