References & Citations
Statistics > Methodology
Title: Approximate nonparametric maximum likelihood inference for mixture models via convex optimization
(Submitted on 7 Jun 2016 (v1), last revised 12 Jan 2018 (this version, v3))
Abstract: Nonparametric maximum likelihood (NPML) for mixture models is a technique for estimating mixing distributions that has a long and rich history in statistics going back to the 1950s, and is closely related to empirical Bayes methods. Historically, NPML-based methods have been considered to be relatively impractical because of computational and theoretical obstacles. However, recent work focusing on approximate NPML methods suggests that these methods may have great promise for a variety of modern applications. Building on this recent work, a class of flexible, scalable, and easy to implement approximate NPML methods is studied for problems with multivariate mixing distributions. Concrete guidance on implementing these methods is provided, with theoretical and empirical support; topics covered include identifying the support set of the mixing distribution, and comparing algorithms (across a variety of metrics) for solving the simple convex optimization problem at the core of the approximate NPML problem. Additionally, three diverse real data applications are studied to illustrate the methods' performance: (i) A baseball data analysis (a classical example for empirical Bayes methods), (ii) high-dimensional microarray classification, and (iii) online prediction of blood-glucose density for diabetes patients. Among other things, the empirical results demonstrate the relative effectiveness of using multivariate (as opposed to univariate) mixing distributions for NPML-based approaches.
Submission history
From: Long Feng [view email][v1] Tue, 7 Jun 2016 03:29:00 GMT (195kb,D)
[v2] Wed, 8 Jun 2016 03:24:44 GMT (195kb,D)
[v3] Fri, 12 Jan 2018 16:39:24 GMT (56kb,D)
Link back to: arXiv, form interface, contact.