We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: Consistency and robustness of kernel-based regression in convex risk minimization

Abstract: We investigate statistical properties for a broad class of modern kernel-based regression (KBR) methods. These kernel methods were developed during the last decade and are inspired by convex risk minimization in infinite-dimensional Hilbert spaces. One leading example is support vector regression. We first describe the relationship between the loss function $L$ of the KBR method and the tail of the response variable. We then establish the $L$-risk consistency for KBR which gives the mathematical justification for the statement that these methods are able to ``learn''. Then we consider robustness properties of such kernel methods. In particular, our results allow us to choose the loss function and the kernel to obtain computationally tractable and consistent KBR methods that have bounded influence functions. Furthermore, bounds for the bias and for the sensitivity curve, which is a finite sample version of the influence function, are developed, and the relationship between KBR and classical $M$ estimators is discussed.
Comments: Published at this http URL in the Bernoulli (this http URL) by the International Statistical Institute/Bernoulli Society (this http URL)
Subjects: Statistics Theory (math.ST)
Journal reference: Bernoulli 2007, Vol. 13, No. 3, 799-819
DOI: 10.3150/07-BEJ5102
Report number: IMS-BEJ-BEJ5102
Cite as: arXiv:0709.0626 [math.ST]
  (or arXiv:0709.0626v1 [math.ST] for this version)

Submission history

From: Andreas Christmann [view email]
[v1] Wed, 5 Sep 2007 11:49:18 GMT (183kb,S)

Link back to: arXiv, form interface, contact.