We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: A universal framework for learning the elliptical mixture model

Abstract: Mixture modelling using elliptical distributions promises enhanced robustness, flexibility and stability over the widely employed Gaussian mixture model (GMM). However, existing studies based on the elliptical mixture model (EMM) are restricted to several specific types of elliptical probability density functions, which are not supported by general solutions or systematic analysis frameworks; this significantly limits the rigour and the power of EMMs in applications. To this end, we propose a novel general framework for estimating and analysing the EMMs, achieved through Riemannian manifold optimisation. First, we investigate the relationships between Riemannian manifolds and elliptical distributions, and the so established connection between the original manifold and a reformulated one indicates a mismatch between those manifolds, the major cause of failure of the existing optimisation for solving general EMMs. We next propose a universal solver which is based on the optimisation of a re-designed cost and prove the existence of the same optimum as in the original problem; this is achieved in a simple, fast and stable way. We further calculate the influence functions of the EMM as theoretical bounds to quantify robustness to outliers. Comprehensive numerical results demonstrate the ability of the proposed framework to accommodate EMMs with different properties of individual functions in a stable way and with fast convergence speed. Finally, the enhanced robustness and flexibility of the proposed framework over the standard GMM are demonstrated both analytically and through comprehensive simulations.
Comments: This work has been accepted to IEEE Transactions on Neural Networks and Learning Systems with DOI:10.1109/TNNLS.2020.3010198. The abstract link is this https URL
Subjects: Machine Learning (cs.LG); Signal Processing (eess.SP); Machine Learning (stat.ML)
DOI: 10.1109/TNNLS.2020.3010198
Cite as: arXiv:1805.08045 [cs.LG]
  (or arXiv:1805.08045v5 [cs.LG] for this version)

Submission history

From: Shengxi Li [view email]
[v1] Mon, 21 May 2018 13:39:22 GMT (121kb,D)
[v2] Tue, 29 May 2018 11:16:32 GMT (121kb,D)
[v3] Sun, 9 Jun 2019 20:09:50 GMT (3550kb,D)
[v4] Sun, 12 Jan 2020 13:45:46 GMT (3864kb,D)
[v5] Mon, 28 Sep 2020 22:13:07 GMT (2790kb,D)

Link back to: arXiv, form interface, contact.