Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Learning without Concentration
(Submitted on 1 Jan 2014 (v1), last revised 22 Oct 2014 (this version, v2))
Abstract: We obtain sharp bounds on the performance of Empirical Risk Minimization performed in a convex class and with respect to the squared loss, without assuming that class members and the target are bounded functions or have rapidly decaying tails.
Rather than resorting to a concentration-based argument, the method used here relies on a `small-ball' assumption and thus holds for classes consisting of heavy-tailed functions and for heavy-tailed targets.
The resulting estimates scale correctly with the `noise level' of the problem, and when applied to the classical, bounded scenario, always improve the known bounds.
Submission history
From: Shahar Mendelson [view email][v1] Wed, 1 Jan 2014 16:28:19 GMT (20kb)
[v2] Wed, 22 Oct 2014 17:59:50 GMT (23kb)
Link back to: arXiv, form interface, contact.