Current browse context:
stat.ME
Change to browse by:
References & Citations
Statistics > Methodology
Title: Regularization in regression: comparing Bayesian and frequentist methods in a poorly informative situation
(Submitted on 2 Oct 2010 (v1), revised 7 Jul 2011 (this version, v2), latest version 15 Nov 2011 (v3))
Abstract: Using a collection of simulated an real benchmarks, we compare Bayesian and frequentist regularization approaches under a low informative constraint when the number of variables is almost equal to the number of observations on simulated and real datasets. This comparison includes new global noninformative approaches for Bayesian variable selection built on Zellner's g-priors that are similar to Liang et al. (2008). The interest of those calibration-free proposals is discussed. The numerical experiments we present highlight the appeal of Bayesian regularization methods, when compared with non-Bayesian alternatives. They dominate frequentist methods in the sense that they provide smaller prediction errors while selecting the most relevant variables in a parsimonious way.
Submission history
From: Jean-Michel Marin [view email][v1] Sat, 2 Oct 2010 07:48:09 GMT (22kb)
[v2] Thu, 7 Jul 2011 06:20:24 GMT (53kb,D)
[v3] Tue, 15 Nov 2011 08:37:57 GMT (83kb,AD)
Link back to: arXiv, form interface, contact.