We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Regression with reject option and application to kNN

Authors: Christophe Denis (LAMA), Mohamed Hebiri (LAMA), Ahmed Zaoui (LAMA)
Abstract: We investigate the problem of regression where one is allowed to abstain from predicting. We refer to this framework as regression with reject option as an extension of classification with reject option. In this context, we focus on the case where the rejection rate is fixed and derive the optimal rule which relies on thresholding the conditional variance function. We provide a semi-supervised estimation procedure of the optimal rule involving two datasets: a first labeled dataset is used to estimate both regression function and conditional variance function while a second unlabeled dataset is exploited to calibrate the desired rejection rate. The resulting predictor with reject option is shown to be almost as good as the optimal predictor with reject option both in terms of risk and rejection rate. We additionally apply our methodology with kNN algorithm and establish rates of convergence for the resulting kNN predictor under mild conditions. Finally, a numerical study is performed to illustrate the benefit of using the proposed procedure.
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)
Journal reference: NeurIPS 2020 - 34th Conference on Neural Information Processing Systems, Dec 2020, Vancouver / Virtuel, Canada
Cite as: arXiv:2006.16597 [stat.ML]
  (or arXiv:2006.16597v2 [stat.ML] for this version)

Submission history

From: Ahmed Zaoui [view email]
[v1] Tue, 30 Jun 2020 08:20:57 GMT (332kb,D)
[v2] Fri, 5 Mar 2021 10:06:36 GMT (44kb,D)

Link back to: arXiv, form interface, contact.