We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Regularization in regression: comparing Bayesian and frequentist methods in a poorly informative situation

Authors: Gilles Celeux (INRIA, Saclay), Mohammed El Anbari (Universite Caddi Ayyad, Marrakech), Jean-Michel Marin (Institut de Mathematiques et Modelisation de Montpellier, Universite de Montpellier 2), Christian P. Robert (Universite Paris-Dauphine & CREST)
Abstract: We propose a global noninformative approach for Bayesian variable selection that builds on Zellner's g-priors and is similar to Liang et al. (2008). Our proposal does not require any kind of calibration. In the case of a benchmark, we compare Bayesian and frequentist regularization approaches under a low informative constraint when the number of variables is almost equal to the number of observations. The simulated and real dataset experiments we present here highlight the appeal of Bayesian regularization methods, when compared with alternatives. They dominate frequentist methods in the sense they provide smaller prediction errors while selecting the most relevant variables in a parsimonious way.
Comments: 19 pages, one figure, nine tables
Subjects: Methodology (stat.ME); Computation (stat.CO)
Cite as: arXiv:1010.0300 [stat.ME]
  (or arXiv:1010.0300v1 [stat.ME] for this version)

Submission history

From: Jean-Michel Marin [view email]
[v1] Sat, 2 Oct 2010 07:48:09 GMT (22kb)
[v2] Thu, 7 Jul 2011 06:20:24 GMT (53kb,D)
[v3] Tue, 15 Nov 2011 08:37:57 GMT (83kb,AD)

Link back to: arXiv, form interface, contact.