We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: Risk bounds for statistical learning

Abstract: We propose a general theorem providing upper bounds for the risk of an empirical risk minimizer (ERM).We essentially focus on the binary classification framework. We extend Tsybakov's analysis of the risk of an ERM under margin type conditions by using concentration inequalities for conveniently weighted empirical processes. This allows us to deal with ways of measuring the ``size'' of a class of classifiers other than entropy with bracketing as in Tsybakov's work. In particular, we derive new risk bounds for the ERM when the classification rules belong to some VC-class under margin conditions and discuss the optimality of these bounds in a minimax sense.
Comments: Published at this http URL in the Annals of Statistics (this http URL) by the Institute of Mathematical Statistics (this http URL)
Subjects: Statistics Theory (math.ST)
MSC classes: 60E15 (Primary) 60F10, 94A17 (Secondary)
Journal reference: Annals of Statistics 2006, Vol. 34, No. 5, 2326-2366
DOI: 10.1214/009053606000000786
Report number: IMS-AOS-AOS0189
Cite as: arXiv:math/0702683 [math.ST]
  (or arXiv:math/0702683v1 [math.ST] for this version)

Submission history

From: Pascal Massart [view email]
[v1] Fri, 23 Feb 2007 09:16:28 GMT (149kb,S)

Link back to: arXiv, form interface, contact.