We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: Optimal designs for Lasso and Dantzig selector using Expander Codes

Authors: Yohann de Castro (LM-Orsay)
Abstract: We investigate the high-dimensional regression problem using adjacency matrices of unbalanced expander graphs. In this frame, we prove that the $\ell_{2}$-prediction error and the $\ell_{1}$-risk of the lasso and the Dantzig selector are optimal up to an explicit multiplicative constant. Thus we can estimate a high-dimensional target vector with an error term similar to the one obtained in a situation where one knows the support of the largest coordinates in advance.
Moreover, we show that these design matrices have an explicit restricted eigenvalue. Precisely, they satisfy the restricted eigenvalue assumption and the compatibility condition with an explicit constant.
Eventually, we capitalize on the recent construction of unbalanced expander graphs due to Guruswami, Umans, and Vadhan, to provide a deterministic polynomial time construction of these design matrices.
Comments: Last version with optimal bounds
Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Probability (math.PR); Methodology (stat.ME); Machine Learning (stat.ML)
MSC classes: 62G05, 62J05, 62J12
Cite as: arXiv:1010.2457 [math.ST]
  (or arXiv:1010.2457v6 [math.ST] for this version)

Submission history

From: Yohann de Castro [view email]
[v1] Tue, 12 Oct 2010 18:03:23 GMT (30kb)
[v2] Fri, 5 Nov 2010 10:43:31 GMT (68kb)
[v3] Thu, 18 Nov 2010 09:19:54 GMT (68kb)
[v4] Thu, 14 Apr 2011 09:57:04 GMT (24kb)
[v5] Wed, 19 Jun 2013 15:07:26 GMT (27kb)
[v6] Tue, 22 Jul 2014 08:56:44 GMT (140kb)

Link back to: arXiv, form interface, contact.