We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Statistics Theory

Title: Rho-estimators revisited: General theory and applications

Authors: Yannick Baraud (JAD), Lucien Birgé (LPMA)
Abstract: Following Baraud, Birg{\'e} and Sart (2014), we pursue our attempt to design a universal and robust estimation method based on independent (but not necessarily i.i.d.) observations. Given such observations with an unknown joint distribution P and a dominated model for P, we build an estimator P based on and measure its risk by an Hellinger-type distance. When P does belong to the model, this risk is bounded by some new notion of dimension which relies on the local complexity of the model in a vicinity of P. In most situations this bound corresponds to the minimax risk over the model (up to a possible logarithmic factor). When P does not belong to the model, its risk involves an additional bias term proportional to the distance between P and , whatever the true distribution P. From this point of view, this new version of $\rho$-estimators improves upon the previous one described in Baraud, Birg{\'e} and Sart (2014) which required that P be absolutely continuous with respect to some known reference measure. Further additional improvements have been brought compared to the former construction. In particular, it provides a very general treatment of the regression framework with random design as well as a computationally tractable procedure for aggregating estimators. Finally, we consider the situation where the Statistician has at disposal many different models and we build a penalized version of the $\rho$-estimator for model selection and adaptation purposes. In the regression setting, this penalized estimator not only allows to estimate the regression function but also the distribution of the errors.
Subjects: Statistics Theory (math.ST)
Cite as: arXiv:1605.05051 [math.ST]
  (or arXiv:1605.05051v2 [math.ST] for this version)

Submission history

From: Lucien Birgé [view email]
[v1] Tue, 17 May 2016 08:16:48 GMT (49kb)
[v2] Fri, 24 Jun 2016 15:36:17 GMT (51kb)
[v3] Mon, 27 Jun 2016 09:34:15 GMT (51kb)
[v4] Sun, 2 Jul 2017 10:46:08 GMT (56kb)
[v5] Wed, 29 Nov 2017 17:56:14 GMT (78kb)

Link back to: arXiv, form interface, contact.