References & Citations
Statistics > Machine Learning
Title: A Risk Comparison of Ordinary Least Squares vs Ridge Regression
(Submitted on 4 May 2011 (v1), last revised 31 May 2013 (this version, v2))
Abstract: We compare the risk of ridge regression to a simple variant of ordinary least squares, in which one simply projects the data onto a finite dimensional subspace (as specified by a Principal Component Analysis) and then performs an ordinary (un-regularized) least squares regression in this subspace. This note shows that the risk of this ordinary least squares method is within a constant factor (namely 4) of the risk of ridge regression.
Submission history
From: Paramveer Dhillon [view email][v1] Wed, 4 May 2011 17:25:52 GMT (4kb)
[v2] Fri, 31 May 2013 16:52:11 GMT (36kb)
Link back to: arXiv, form interface, contact.