We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: Convergence Analysis of Gradient EM for Multi-component Gaussian Mixture

Abstract: In this paper, we study convergence properties of the gradient Expectation-Maximization algorithm \cite{lange1995gradient} for Gaussian Mixture Models for general number of clusters and mixing coefficients. We derive the convergence rate depending on the mixing coefficients, minimum and maximum pairwise distances between the true centers and dimensionality and number of components; and obtain a near-optimal local contraction radius. While there have been some recent notable works that derive local convergence rates for EM in the two equal mixture symmetric GMM, in the more general case, the derivations need structurally different and non-trivial arguments. We use recent tools from learning theory and empirical processes to achieve our theoretical results.
Comments: 36 pages
Subjects: Statistics Theory (math.ST); Machine Learning (cs.LG)
Cite as: arXiv:1705.08530 [math.ST]
  (or arXiv:1705.08530v2 [math.ST] for this version)

Submission history

From: Bowei Yan [view email]
[v1] Tue, 23 May 2017 20:47:17 GMT (92kb,D)
[v2] Mon, 4 Dec 2017 18:16:50 GMT (99kb,D)

Link back to: arXiv, form interface, contact.