We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: Bayesian Group Regularization in Generalized Linear Models with a Continuous Spike-and-Slab Prior

Authors: Ray Bai
Abstract: We study Bayesian group-regularized estimation in high-dimensional generalized linear models (GLMs) under a continuous spike-and-slab prior. Our framework covers both canonical and non-canonical link functions and subsumes logistic regression, Poisson regression, Gaussian regression, and negative binomial regression with group sparsity. Under milder assumptions than those previously assumed for the group lasso, we obtain the convergence rate for both the maximum a posteriori (MAP) estimator and the full posterior distribution. Our theoretical results thus justify the use of the posterior mode as a point estimator. Furthermore, the posterior distribution contracts at the same rate as the MAP estimator, an attractive feature of our approach which is not the case for the group lasso. For computation, we propose an expectation-maximization (EM) algorithm for rapidly obtaining MAP estimates under our model. We illustrate our method through simulations and a real data application on predicting human immunodeficiency virus (HIV) drug resistance from protein sequences.
Comments: 39 pages, 3 tables. Paper has significantly changed to focus on grouped generalized linear models (GLMs) instead of specifically generalized additive models
Subjects: Methodology (stat.ME)
Cite as: arXiv:2007.07021 [stat.ME]
  (or arXiv:2007.07021v6 [stat.ME] for this version)

Submission history

From: Ray Bai [view email]
[v1] Tue, 14 Jul 2020 13:29:13 GMT (54kb,D)
[v2] Sun, 26 Jul 2020 19:57:31 GMT (55kb,D)
[v3] Wed, 29 Jul 2020 06:13:38 GMT (55kb,D)
[v4] Mon, 21 Sep 2020 16:57:47 GMT (57kb,D)
[v5] Sat, 5 Jun 2021 15:22:40 GMT (101kb,D)
[v6] Thu, 29 Jun 2023 03:15:45 GMT (43kb)

Link back to: arXiv, form interface, contact.