We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: Hypothesis testing for high-dimensional sparse binary regression

Abstract: In this paper, we study the detection boundary for minimax hypothesis testing in the context of high-dimensional, sparse binary regression models. Motivated by genetic sequencing association studies for rare variant effects, we investigate the complexity of the hypothesis testing problem when the design matrix is sparse. We observe a new phenomenon in the behavior of detection boundary which does not occur in the case of Gaussian linear regression. We derive the detection boundary as a function of two components: a design matrix sparsity index and signal strength, each of which is a function of the sparsity of the alternative. For any alternative, if the design matrix sparsity index is too high, any test is asymptotically powerless irrespective of the magnitude of signal strength. For binary design matrices with the sparsity index that is not too high, our results are parallel to those in the Gaussian case. In this context, we derive detection boundaries for both dense and sparse regimes. For the dense regime, we show that the generalized likelihood ratio is rate optimal; for the sparse regime, we propose an extended Higher Criticism Test and show it is rate optimal and sharp. We illustrate the finite sample properties of the theoretical results using simulation studies.
Comments: Published in at this http URL the Annals of Statistics (this http URL) by the Institute of Mathematical Statistics (this http URL)
Subjects: Statistics Theory (math.ST); Computation (stat.CO); Methodology (stat.ME)
Journal reference: Annals of Statistics 2015, Vol. 43, No. 1, 352-381
DOI: 10.1214/14-AOS1279
Report number: IMS-AOS-AOS1279
Cite as: arXiv:1308.0764 [math.ST]
  (or arXiv:1308.0764v3 [math.ST] for this version)

Submission history

From: Rajarshi Mukherjee [view email]
[v1] Sun, 4 Aug 2013 01:06:15 GMT (134kb,D)
[v2] Mon, 28 Jul 2014 02:42:31 GMT (109kb,D)
[v3] Thu, 5 Mar 2015 10:30:23 GMT (216kb)

Link back to: arXiv, form interface, contact.