We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: A Riemannian Newton Trust-Region Method for Fitting Gaussian Mixture Models

Abstract: Gaussian Mixture Models are a powerful tool in Data Science and Statistics that are mainly used for clustering and density approximation. The task of estimating the model parameters is in practice often solved by the Expectation Maximization (EM) algorithm which has its benefits in its simplicity and low per-iteration costs. However, the EM converges slowly if there is a large share of hidden information or overlapping clusters. Recent advances in manifold optimization for Gaussian Mixture Models have gained increasing interest. We introduce an explicit formula for the Riemannian Hessian for Gaussian Mixture Models. On top, we propose a new Riemannian Newton Trust-Region method which outperforms current approaches both in terms of runtime and number of iterations. We apply our method on clustering problems and density approximation tasks. Our method is very powerful for data with a large share of hidden information compared to existing methods.
Comments: 32 pages
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC); Computation (stat.CO)
ACM classes: G.1.6; G.3
Journal reference: Stat Comput 32, 8 (2022)
DOI: 10.1007/s11222-021-10071-1
Cite as: arXiv:2104.14957 [stat.ML]
  (or arXiv:2104.14957v2 [stat.ML] for this version)

Submission history

From: Lena Sembach [view email]
[v1] Fri, 30 Apr 2021 12:48:32 GMT (392kb,D)
[v2] Wed, 24 Aug 2022 10:03:30 GMT (1028kb,D)

Link back to: arXiv, form interface, contact.