We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: Singularity structures and impacts on parameter estimation in finite mixtures of distributions

Abstract: Singularities of a statistical model are the elements of the model's parameter space which make the corresponding Fisher information matrix degenerate. These are the points for which estimation techniques such as the maximum likelihood estimator and standard Bayesian procedures do not admit the root-$n$ parametric rate of convergence. We propose a general framework for the identification of singularity structures of the parameter space of finite mixtures, and study the impacts of the singularity structures on minimax lower bounds and rates of convergence for the maximum likelihood estimator over a compact parameter space. Our study makes explicit the deep links between model singularities, parameter estimation convergence rates and minimax lower bounds, and the algebraic geometry of the parameter space for mixtures of continuous distributions. The theory is applied to establish concrete convergence rates of parameter estimation for finite mixture of skew-normal distributions. This rich and increasingly popular mixture model is shown to exhibit a remarkably complex range of asymptotic behaviors which have not been hitherto reported in the literature.
Comments: 87 pages. This version has improved introduction and expanded discussion of related work. An abridged version is to appear on SIAM Journal on Mathematics of Data Science
Subjects: Statistics Theory (math.ST); Machine Learning (stat.ML)
Cite as: arXiv:1609.02655 [math.ST]
  (or arXiv:1609.02655v4 [math.ST] for this version)

Submission history

From: Nhat Ho [view email]
[v1] Fri, 9 Sep 2016 04:22:03 GMT (72kb)
[v2] Sat, 1 Sep 2018 19:06:27 GMT (99kb)
[v3] Thu, 18 Jul 2019 21:05:28 GMT (101kb)
[v4] Tue, 23 Jul 2019 22:12:15 GMT (102kb)

Link back to: arXiv, form interface, contact.