We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Robust subset selection

Authors: Ryan Thompson
Abstract: The best subset selection (or "best subsets") estimator is a classic tool for sparse regression, and developments in mathematical optimization over the past decade have made it more computationally tractable than ever. Notwithstanding its desirable statistical properties, the best subsets estimator is susceptible to outliers and can break down in the presence of a single contaminated data point. To address this issue, a robust adaption of best subsets is proposed that is highly resistant to contamination in both the response and the predictors. The adapted estimator generalizes the notion of subset selection to both predictors and observations, thereby achieving robustness in addition to sparsity. This procedure, referred to as "robust subset selection" (or "robust subsets"), is defined by a combinatorial optimization problem for which modern discrete optimization methods are applied. The robustness of the estimator in terms of the finite-sample breakdown point of its objective value is formally established. In support of this result, experiments on synthetic and real data are reported that demonstrate the superiority of robust subsets over best subsets in the presence of contamination. Importantly, robust subsets fares competitively across several metrics compared with popular robust adaptions of continuous shrinkage estimators.
Comments: To appear in Computational Statistics & Data Analysis
Subjects: Methodology (stat.ME)
DOI: 10.1016/j.csda.2021.107415
Cite as: arXiv:2005.08217 [stat.ME]
  (or arXiv:2005.08217v3 [stat.ME] for this version)

Submission history

From: Ryan Thompson [view email]
[v1] Sun, 17 May 2020 10:56:33 GMT (72kb,D)
[v2] Tue, 2 Jun 2020 09:00:24 GMT (72kb,D)
[v3] Mon, 10 Jan 2022 03:22:35 GMT (102kb,D)

Link back to: arXiv, form interface, contact.