We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: High-Dimensional Trimmed Estimators: A General Framework for Robust Structured Estimation

Abstract: We consider the problem of robustifying high-dimensional structured estimation. Robust techniques are key in real-world applications, as these often involve outliers and data corruption. We focus on trimmed versions of structurally regularized M-estimators in the high-dimensional setting, including the popular Least Trimmed Squared estimator, as well as analogous estimators for generalized linear models, graphical models, using possibly non-convex loss functions. We present a general analysis of their statistical convergence rates and consistency, and show how to extend any algorithms for M-estimators to fit trimmed variants. We then take a closer look at the $\ell_1$-regularized Least Trimmed Squared estimator as a special case. Our results show that this estimator can tolerate a larger fraction of corrupted observations than state-of-the-art alternatives. The competitive performance of high-dimensional trimmed estimators is illustrated numerically using both simulated and real-world genomics data.
Comments: 24 pages, 6 figures
Subjects: Machine Learning (stat.ML)
MSC classes: 65K10, 90C06, 62F35, 47N30
Cite as: arXiv:1605.08299 [stat.ML]
  (or arXiv:1605.08299v1 [stat.ML] for this version)

Submission history

From: Aleksandr Aravkin [view email]
[v1] Thu, 26 May 2016 14:26:20 GMT (1168kb,D)
[v2] Mon, 21 Aug 2017 12:50:26 GMT (4000kb,D)

Link back to: arXiv, form interface, contact.