We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: Efficient Nonparametric Smoothness Estimation

Abstract: Sobolev quantities (norms, inner products, and distances) of probability density functions are important in the theory of nonparametric statistics, but have rarely been used in practice, partly due to a lack of practical estimators. They also include, as special cases, $L^2$ quantities which are used in many applications. We propose and analyze a family of estimators for Sobolev quantities of unknown probability density functions. We bound the bias and variance of our estimators over finite samples, finding that they are generally minimax rate-optimal. Our estimators are significantly more computationally tractable than previous estimators, and exhibit a statistical/computational trade-off allowing them to adapt to computational constraints. We also draw theoretical connections to recent work on fast two-sample testing. Finally, we empirically validate our estimators on synthetic data.
Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Machine Learning (stat.ML)
Cite as: arXiv:1605.05785 [math.ST]
  (or arXiv:1605.05785v2 [math.ST] for this version)

Submission history

From: Shashank Singh [view email]
[v1] Thu, 19 May 2016 00:29:38 GMT (63kb,D)
[v2] Fri, 22 Jul 2016 02:47:02 GMT (62kb,D)

Link back to: arXiv, form interface, contact.