References & Citations
Mathematics > Statistics Theory
Title: Semi-Supervised linear regression
(Submitted on 7 Dec 2016 (v1), last revised 13 Apr 2021 (this version, v4))
Abstract: We study a regression problem where for some part of the data we observe both the label variable ($Y$) and the predictors (${\bf X}$), while for other part of the data only the predictors are given. Such a problem arises, for example, when observations of the label variable are costly and may require a skilled human agent. When the conditional expectation $E[Y | {\bf X}]$ is not exactly linear, one can consider the best linear approximation to the conditional expectation, which can be estimated consistently by the least squares estimates (LSE). The latter depends only on the labeled data. We suggest improved alternative estimates to the LSE that use also the unlabeled data. Our estimation method can be easily implemented and has simply described asymptotic properties.The new estimates asymptotically dominate the usual standard procedures under certain non-linearity condition of $E[Y | {\bf X}]$; otherwise, they are asymptotically equivalent.The performance of the new estimator for small sample size is investigated in an extensive simulation study. A real data example of inferring homeless population is used to illustrate the new methodology.
Submission history
From: David Azriel [view email][v1] Wed, 7 Dec 2016 19:52:55 GMT (49kb)
[v2] Sun, 16 Sep 2018 07:16:20 GMT (57kb)
[v3] Sun, 4 Apr 2021 11:23:40 GMT (558kb,D)
[v4] Tue, 13 Apr 2021 07:40:58 GMT (558kb,D)
Link back to: arXiv, form interface, contact.