We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Are deep learning models superior for missing data imputation in large surveys? Evidence from an empirical comparison

Abstract: Multiple imputation (MI) is a popular approach for dealing with missing data arising from non-response in sample surveys. Multiple imputation by chained equations (MICE) is one of the most widely used MI algorithms for multivariate data, but it lacks theoretical foundation and is computationally intensive. Recently, missing data imputation methods based on deep learning models have been developed with encouraging results in small studies. However, there has been limited research on evaluating their performance in realistic settings compared to MICE, particularly in big surveys. We conduct extensive simulation studies based on a subsample of the American Community Survey to compare the repeated sampling properties of four machine learning based MI methods: MICE with classification trees, MICE with random forests, generative adversarial imputation networks, and multiple imputation using denoising autoencoders. We find the deep learning imputation methods are superior to MICE in terms of computational time. However, with the default choice of hyperparameters in the common software packages, MICE with classification trees consistently outperforms, often by a large margin, the deep learning imputation methods in terms of bias, mean squared error, and coverage under a range of realistic settings.
Subjects: Machine Learning (cs.LG); Applications (stat.AP); Machine Learning (stat.ML)
Cite as: arXiv:2103.09316 [cs.LG]
  (or arXiv:2103.09316v3 [cs.LG] for this version)

Submission history

From: Zhenhua Wang [view email]
[v1] Sun, 14 Mar 2021 16:24:04 GMT (653kb,D)
[v2] Tue, 8 Feb 2022 19:19:16 GMT (784kb,D)
[v3] Sat, 19 Mar 2022 05:59:11 GMT (784kb,D)

Link back to: arXiv, form interface, contact.