References & Citations
Mathematics > Statistics Theory
Title: Fast learning rates for plug-in classifiers under the margin condition
(Submitted on 8 Jul 2005 (v1), last revised 27 May 2011 (this version, v3))
Abstract: It has been recently shown that, under the margin (or low noise) assumption, there exist classifiers attaining fast rates of convergence of the excess Bayes risk, i.e., the rates faster than $n^{-1/2}$. The works on this subject suggested the following two conjectures: (i) the best achievable fast rate is of the order $n^{-1}$, and (ii) the plug-in classifiers generally converge slower than the classifiers based on empirical risk minimization. We show that both conjectures are not correct. In particular, we construct plug-in classifiers that can achieve not only the fast, but also the {\it super-fast} rates, i.e., the rates faster than $n^{-1}$. We establish minimax lower bounds showing that the obtained rates cannot be improved.
Submission history
From: Jean-Yves Audibert [view email][v1] Fri, 8 Jul 2005 15:11:44 GMT (37kb)
[v2] Tue, 13 Sep 2005 08:54:47 GMT (37kb)
[v3] Fri, 27 May 2011 14:17:32 GMT (37kb)
Link back to: arXiv, form interface, contact.