We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Ancillary-file links:

Ancillary files (details):

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Regularization in regression: comparing Bayesian and frequentist methods in a poorly informative situation

Abstract: Using a collection of simulated an real benchmarks, we compare Bayesian and frequentist regularization approaches under a low informative constraint when the number of variables is almost equal to the number of observations on simulated and real datasets. This comparison includes new global noninformative approaches for Bayesian variable selection built on Zellner's g-priors that are similar to Liang et al. (2008). The interest of those calibration-free proposals is discussed. The numerical experiments we present highlight the appeal of Bayesian regularization methods, when compared with non-Bayesian alternatives. They dominate frequentist methods in the sense that they provide smaller prediction errors while selecting the most relevant variables in a parsimonious way.
Subjects: Methodology (stat.ME); Computation (stat.CO)
Cite as: arXiv:1010.0300 [stat.ME]
  (or arXiv:1010.0300v3 [stat.ME] for this version)

Submission history

From: Jean-Michel Marin [view email]
[v1] Sat, 2 Oct 2010 07:48:09 GMT (22kb)
[v2] Thu, 7 Jul 2011 06:20:24 GMT (53kb,D)
[v3] Tue, 15 Nov 2011 08:37:57 GMT (83kb,AD)

Link back to: arXiv, form interface, contact.