References & Citations
Statistics > Methodology
Title: Influence of single observations on the choice of the penalty parameter in ridge regression
(Submitted on 9 Nov 2019 (v1), last revised 23 Jun 2023 (this version, v2))
Abstract: Penalized regression methods such as ridge regression heavily rely on the choice of a tuning or penalty parameter, which is often computed via cross-validation. Discrepancies in the value of the penalty parameter may lead to substantial differences in regression coefficient estimates and predictions. In this paper, we investigate the effect of single observations on the optimal choice of the tuning parameter, showing how the presence of influential points can change it dramatically. We distinguish between points as ``expanders'' and ``shrinkers'', based on their effect on the model complexity. Our approach supplies a visual exploratory tool to identify influential points, naturally implementable for high-dimensional data where traditional approaches usually fail. Applications to simulated and real data examples, both low- and high-dimensional, are presented. The visual tool is implemented in the R package influridge.
Submission history
From: Kristoffer H. Hellton [view email][v1] Sat, 9 Nov 2019 10:53:13 GMT (249kb)
[v2] Fri, 23 Jun 2023 12:26:13 GMT (301kb)
Link back to: arXiv, form interface, contact.