We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: The constrained Dantzig selector with enhanced consistency

Abstract: The Dantzig selector has received popularity for many applications such as compressed sensing and sparse modeling, thanks to its computational efficiency as a linear programming problem and its nice sampling properties. Existing results show that it can recover sparse signals mimicking the accuracy of the ideal procedure, up to a logarithmic factor of the dimensionality. Such a factor has been shown to hold for many regularization methods. An important question is whether this factor can be reduced to a logarithmic factor of the sample size in ultra-high dimensions under mild regularity conditions. To provide an affirmative answer, in this paper we suggest the constrained Dantzig selector, which has more flexible constraints and parameter space. We prove that the suggested method can achieve convergence rates within a logarithmic factor of the sample size of the oracle rates and improved sparsity, under a fairly weak assumption on the signal strength. Such improvement is significant in ultra-high dimensions. This method can be implemented efficiently through sequential linear programming. Numerical studies confirm that the sample size needed for a certain level of accuracy in these problems can be much reduced.
Comments: to appear in Journal of Machine Learning Research
Subjects: Methodology (stat.ME); Machine Learning (stat.ML)
MSC classes: 62J05(Primary), 62F07, 62J07, 94A20(Secondary)
Cite as: arXiv:1605.03311 [stat.ME]
  (or arXiv:1605.03311v1 [stat.ME] for this version)

Submission history

From: Jinchi Lv [view email]
[v1] Wed, 11 May 2016 07:41:50 GMT (56kb)

Link back to: arXiv, form interface, contact.