We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Statistics Theory

Title: On the nonparametric maximum likelihood estimator for Gaussian location mixture densities with application to Gaussian denoising

Abstract: We study the Nonparametric Maximum Likelihood Estimator (NPMLE) for estimating Gaussian location mixture densities in $d$-dimensions from independent observations. Unlike usual likelihood-based methods for fitting mixtures, NPMLEs are based on convex optimization. We prove finite sample results on the Hellinger accuracy of every NPMLE. Our results imply, in particular, that every NPMLE achieves near parametric risk (up to logarithmic multiplicative factors) when the true density is a discrete Gaussian mixture without any prior information on the number of mixture components. NPMLEs can naturally be used to yield empirical Bayes estimates of the Oracle Bayes estimator in the Gaussian denoising problem. We prove bounds for the accuracy of the empirical Bayes estimate as an approximation to the Oracle Bayes estimator. Here our results imply that the empirical Bayes estimator performs at nearly the optimal level (up to logarithmic multiplicative factors) for denoising in clustering situations without any prior knowledge of the number of clusters.
Subjects: Statistics Theory (math.ST); Computation (stat.CO); Machine Learning (stat.ML)
Cite as: arXiv:1712.02009 [math.ST]
  (or arXiv:1712.02009v2 [math.ST] for this version)

Submission history

From: Adityanand Guntuboyina [view email]
[v1] Wed, 6 Dec 2017 02:30:08 GMT (1163kb,D)
[v2] Sun, 7 Jul 2019 23:36:07 GMT (1391kb,D)

Link back to: arXiv, form interface, contact.