We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Estimating The Proportion of Signal Variables Under Arbitrary Covariance Dependence

Abstract: Accurately estimating the proportion of signals hidden in a large amount of noise variables is of interest in many scientific inquires. In this paper, we consider realistic but theoretically challenging settings with arbitrary covariance dependence between variables. We define mean absolute correlation (MAC) to measure the overall dependence strength and investigate a family of estimators for their performances in the full range of MAC. We explicit the joint effect of MAC and signal sparsity on the performances of the family of estimators and discover that the most powerful estimator under independence is no longer most effective when the MAC dependence is strong enough. Motivated by the theoretical insight, we propose a new estimator to better adapt to arbitrary covariance dependence. The proposed method compares favorably to several existing methods in extensive finite-sample settings with strong to weak covariance dependence and real dependence structures from genetic association studies.
Subjects: Methodology (stat.ME); Statistics Theory (math.ST)
Cite as: arXiv:2102.09053 [stat.ME]
  (or arXiv:2102.09053v1 [stat.ME] for this version)

Submission history

From: X. Jessie Jeng [view email]
[v1] Wed, 17 Feb 2021 22:20:13 GMT (318kb,D)
[v2] Fri, 9 Apr 2021 16:45:01 GMT (639kb,D)

Link back to: arXiv, form interface, contact.