We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Singular ridge regression with homoscedastic residuals: generalization error with estimated parameters

Abstract: This paper characterizes the conditional distribution properties of the finite sample ridge regression estimator and uses that result to evaluate total regression and generalization errors that incorporate the inaccuracies committed at the time of parameter estimation. The paper provides explicit formulas for those errors. Unlike other classical references in this setup, our results take place in a fully singular setup that does not assume the existence of a solution for the non-regularized regression problem. In exchange, we invoke a conditional homoscedasticity hypothesis on the regularized regression residuals that is crucial in our developments.
Comments: 24 pages, 2 figures
Subjects: Machine Learning (stat.ML); Methodology (stat.ME)
Cite as: arXiv:1605.09026 [stat.ML]
  (or arXiv:1605.09026v1 [stat.ML] for this version)

Submission history

From: Juan-Pablo Ortega [view email]
[v1] Sun, 29 May 2016 16:45:23 GMT (109kb,D)

Link back to: arXiv, form interface, contact.