References & Citations
Mathematics > Statistics Theory
Title: On optimality of empirical risk minimization in linear aggregation
(Submitted on 11 May 2016 (v1), revised 7 Jun 2016 (this version, v2), latest version 18 Oct 2016 (v3))
Abstract: In the first part of this paper, we show that the small-ball condition, recently introduced by Mendelson (2015), may behave poorly for important classes of localized functions such as wavelets, leading to suboptimal estimates of the rate of convergence of ERM for the linear aggregation problem. In a second part, we derive optimal upper and lower bounds for the excess risk of ERM when the dictionary is made of trigonometric functions. While the validity of the small-ball condition remains essentially open in the Fourier case, we show strong connection between our results and concentration inequalities recently obtained for the excess risk in Chatterjee (2014) and van de Geer and Wainwright (2016).
Submission history
From: Adrien Saumard [view email][v1] Wed, 11 May 2016 13:25:39 GMT (29kb)
[v2] Tue, 7 Jun 2016 11:37:26 GMT (29kb)
[v3] Tue, 18 Oct 2016 09:35:34 GMT (27kb)
Link back to: arXiv, form interface, contact.