Current browse context:
stat
Change to browse by:
References & Citations
Statistics > Methodology
Title: A review and recommendations on variable selection methods in regression models for binary data
(Submitted on 16 Jan 2022 (v1), last revised 16 May 2022 (this version, v2))
Abstract: The selection of essential variables in logistic regression is vital because of its extensive use in medical studies, finance, economics and related fields. In this paper, we explore four main typologies (test-based, penalty-based, screening-based, and tree-based) of frequentist variable selection methods in logistic regression setup. Primary objective of this work is to give a comprehensive overview of the existing literature for practitioners. Underlying assumptions and theory, along with the specifics of their implementations, are detailed as well. Next, we conduct a thorough simulation study to explore the performances of fifteen different methods in terms of variable selection, estimation of coefficients, prediction accuracy as well as time complexity under various settings. We take low, moderate and high dimensional setups and consider different correlation structures for the covariates. A real-life application, using a high-dimensional gene expression data, is also included in this study to further understand the efficacy and consistency of the methods. Finally, based on our findings in the simulated data and in the real data, we provide recommendations for practitioners on the choice of variable selection methods under various contexts.
Submission history
From: Soudeep Deb [view email][v1] Sun, 16 Jan 2022 15:02:54 GMT (59kb)
[v2] Mon, 16 May 2022 05:47:18 GMT (192kb,D)
Link back to: arXiv, form interface, contact.