We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Statistics Theory

Title: Universal Robust Regression via Maximum Mean Discrepancy

Abstract: Many modern datasets are collected automatically and are thus easily contaminated by outliers. This led to a regain of interest in robust estimation, including new notions of robustness such as robustness to adversarial contamination of the data. However, most robust estimation methods are designed for a specific model. Notably, many methods were proposed recently to obtain robust estimators in linear models (or generalized linear models), and a few were developed for very specific settings, for example beta regression or sample selection models. In this paper we develop a new approach for robust estimation in arbitrary regression models, based on Maximum Mean Discrepancy minimization. We build two estimators which are both proven to be robust to Huber-type contamination. We obtain a non-asymptotic error bound for one them and show that it is also robust to adversarial contamination, but this estimator is computationally more expensive to use in practice than the other one. As a byproduct of our theoretical analysis of the proposed estimators we derive new results on kernel conditional mean embedding of distributions which are of independent interest.
Comments: 51 pages, 5 tables (revised version)
Subjects: Statistics Theory (math.ST)
Cite as: arXiv:2006.00840 [math.ST]
  (or arXiv:2006.00840v4 [math.ST] for this version)

Submission history

From: Mathieu Gerber [view email]
[v1] Mon, 1 Jun 2020 10:34:18 GMT (47kb,D)
[v2] Tue, 13 Jul 2021 14:04:48 GMT (42kb)
[v3] Mon, 16 May 2022 15:31:37 GMT (55kb)
[v4] Tue, 24 Jan 2023 11:03:48 GMT (47kb)

Link back to: arXiv, form interface, contact.