We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Tuning parameter selection in high dimensional penalized likelihood

Abstract: Determining how to appropriately select the tuning parameter is essential in penalized likelihood methods for high-dimensional data analysis. We examine this problem in the setting of penalized likelihood methods for generalized linear models, where the dimensionality of covariates p is allowed to increase exponentially with the sample size n. We propose to select the tuning parameter by optimizing the generalized information criterion (GIC) with an appropriate model complexity penalty. To ensure that we consistently identify the true model, a range for the model complexity penalty is identified in GIC. We find that this model complexity penalty should diverge at the rate of some power of $\log p$ depending on the tail probability behavior of the response variables. This reveals that using the AIC or BIC to select the tuning parameter may not be adequate for consistently identifying the true model. Based on our theoretical study, we propose a uniform choice of the model complexity penalty and show that the proposed approach consistently identifies the true model among candidate models with asymptotic probability one. We justify the performance of the proposed procedure by numerical simulations and a gene expression data analysis.
Comments: 38 pages
Subjects: Methodology (stat.ME); Machine Learning (stat.ML)
MSC classes: 62J12(Primary) 62J07(Secondary)
Journal reference: Journal of the Royal Statistical Society Series B 75, 531-552 (2013)
DOI: 10.1111/rssb.12001
Cite as: arXiv:1605.03321 [stat.ME]
  (or arXiv:1605.03321v1 [stat.ME] for this version)

Submission history

From: Yingying Fan [view email]
[v1] Wed, 11 May 2016 08:17:58 GMT (56kb)

Link back to: arXiv, form interface, contact.