We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: Distributed nonparametric regression imputation for missing response problems with large-scale data

Abstract: Nonparametric regression imputation is commonly used in missing data analysis.
However, it suffers from the ``curse of dimension".
The problem can be alleviated by the explosive sample size in the era of big data, while the large-scale data size presents some challenges on the storage of data and the calculation of estimators.
These challenges make the classical nonparametric regression imputation methods no longer applicable.
This motivates us to develop two distributed nonparametric regression imputation methods.
One is based on kernel smoothing and the other on the sieve method.
The kernel-based distributed imputation method has extremely low communication cost and the sieve-based distributed imputation method can accommodate more local machines. To illustrate the proposed imputation methods, response mean
estimation is considered.
Two distributed nonparametric regression imputation estimators are proposed for the response mean, which are proved to be asymptotically normal with asymptotic variances achieving the semiparametric efficiency bound.
The proposed methods are evaluated through simulation studies and are illustrated by a real data analysis.
Subjects: Methodology (stat.ME)
Journal reference: Journal of Machine Learning Research, 2023
Cite as: arXiv:2106.02475 [stat.ME]
  (or arXiv:2106.02475v2 [stat.ME] for this version)

Submission history

From: Ruoyu Wang [view email]
[v1] Fri, 4 Jun 2021 13:29:35 GMT (38kb,D)
[v2] Sun, 8 Jan 2023 14:50:40 GMT (156kb)

Link back to: arXiv, form interface, contact.