References & Citations
Mathematics > Statistics Theory
Title: Variable selection with Hamming loss
(Submitted on 6 Dec 2015 (v1), last revised 12 Oct 2018 (this version, v5))
Abstract: We derive non-asymptotic bounds for the minimax risk of variable selection under expected Hamming loss in the Gaussian mean model in $\mathbb{R}^d$ for classes of $s$-sparse vectors separated from 0 by a constant $a > 0$. In some cases, we get exact expressions for the nonasymptotic minimax risk as a function of $d, s, a$ and find explicitly the minimax selectors. These results are extended to dependent or non-Gaussian observations and to the problem of crowdsourcing. Analogous conclusions are obtained for the probability of wrong recovery of the sparsity pattern. As corollaries, we derive necessary and sufficient conditions for such asymptotic properties as almost full recovery and exact recovery. Moreover, we propose data-driven selectors that provide almost full and exact recovery adaptively to the parameters of the classes.
Submission history
From: Mohamed Ndaoud [view email][v1] Sun, 6 Dec 2015 20:50:50 GMT (19kb)
[v2] Fri, 23 Sep 2016 16:44:16 GMT (23kb)
[v3] Sun, 15 Jan 2017 17:53:59 GMT (27kb)
[v4] Fri, 10 Mar 2017 12:39:22 GMT (30kb)
[v5] Fri, 12 Oct 2018 14:28:19 GMT (38kb)
Link back to: arXiv, form interface, contact.