References & Citations
Mathematics > Statistics Theory
Title: Optimal rates and adaptation in the single-index model using aggregation
(Submitted on 23 Mar 2007 (v1), last revised 4 Dec 2007 (this version, v2))
Abstract: We want to recover the regression function in the single-index model. Using an aggregation algorithm with local polynomial estimators, we answer in particular to the second part of Question~2 from Stone (1982) on the optimal convergence rate. The procedure constructed here has strong adaptation properties: it adapts both to the smoothness of the link function and to the unknown index. Moreover, the procedure locally adapts to the distribution of the design. We propose new upper bounds for the local polynomial estimator (which are results of independent interest) that allows a fairly general design. The behavior of this algorithm is studied through numerical simulations. In particular, we show empirically that it improves strongly over empirical risk minimization.
Submission history
From: Stephane Gaiffas [view email] [via CCSD proxy][v1] Fri, 23 Mar 2007 18:40:07 GMT (271kb)
[v2] Tue, 4 Dec 2007 08:19:55 GMT (353kb)
Link back to: arXiv, form interface, contact.