We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Theory

Title: Consistent Density Estimation Under Discrete Mixture Models

Abstract: This work considers a problem of estimating a mixing probability density $f$ in the setting of discrete mixture models. The paper consists of three parts.
The first part focuses on the construction of an $L_1$ consistent estimator of $f$. In particular, under the assumptions that the probability measure $\mu$ of the observation is atomic, and the map from $f$ to $\mu$ is bijective, it is shown that there exists an estimator $f_n$ such that for every density $f$ $\lim_{n\to \infty} \mathbb{E} \left[ \int |f_n -f | \right]=0$.
The second part discusses the implementation details. Specifically, it is shown that the consistency for every $f$ can be attained with a computationally feasible estimator.
The third part, as a study case, considers a Poisson mixture model. In particular, it is shown that in the Poisson noise setting, the bijection condition holds and, hence, estimation can be performed consistently for every $f$.
Comments: To appear in proceedings of the 2021 IEEE International Symposium on Information Theory (ISIT)
Subjects: Information Theory (cs.IT); Statistics Theory (math.ST); Machine Learning (stat.ML)
Cite as: arXiv:2105.01108 [cs.IT]
  (or arXiv:2105.01108v1 [cs.IT] for this version)

Submission history

From: Alex Dytso [view email]
[v1] Mon, 3 May 2021 18:30:02 GMT (22kb)
[v2] Mon, 10 May 2021 12:49:46 GMT (0kb,I)

Link back to: arXiv, form interface, contact.