We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Scalable Bayesian regression in high dimensions with multiple data sources

Abstract: Applications of high-dimensional regression often involve multiple sources or types of covariates. We propose methodology for this setting, emphasizing the "wide data" regime with large total dimensionality p and sample size n<<p. We focus on a flexible ridge-type prior with shrinkage levels that are specific to each data type or source and that are set automatically by empirical Bayes. All estimation, including setting of shrinkage levels, is formulated mainly in terms of inner product matrices of size n x n. This renders computation efficient in the wide data regime and allows scaling to problems with millions of features. Furthermore, the proposed procedures are free of user-set tuning parameters. We show how sparsity can be achieved by post-processing of the Bayesian output via constrained minimization of a certain Kullback-Leibler divergence. This yields sparse solutions with adaptive, source-specific shrinkage, including a closed-form variant that scales to very large p. We present empirical results from a simulation study based on real data and a case study in Alzheimer's disease involving millions of features and multiple data sources.
Subjects: Methodology (stat.ME); Computation (stat.CO)
DOI: 10.1080/10618600.2019.1624294
Cite as: arXiv:1710.00596 [stat.ME]
  (or arXiv:1710.00596v7 [stat.ME] for this version)

Submission history

From: Konstantinos Perrakis [view email]
[v1] Mon, 2 Oct 2017 12:00:23 GMT (72kb,D)
[v2] Fri, 10 Nov 2017 14:09:30 GMT (83kb,D)
[v3] Wed, 29 Nov 2017 12:36:54 GMT (83kb,D)
[v4] Thu, 30 Nov 2017 10:23:39 GMT (83kb,D)
[v5] Fri, 19 Jan 2018 14:28:24 GMT (85kb,D)
[v6] Wed, 5 Jun 2019 08:44:31 GMT (389kb,D)
[v7] Wed, 21 Aug 2019 12:00:29 GMT (385kb,D)

Link back to: arXiv, form interface, contact.