We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: On the dimension effect of regularized linear discriminant analysis

Abstract: This paper studies the dimension effect of the linear discriminant analysis (LDA) and the regularized linear discriminant analysis (RLDA) classifiers for large dimensional data where the observation dimension $p$ is of the same order as the sample size $n$. More specifically, built on properties of the Wishart distribution and recent results in random matrix theory, we derive explicit expressions for the asymptotic misclassification errors of LDA and RLDA respectively, from which we gain insights of how dimension affects the performance of classification and in what sense. Motivated by these results, we propose adjusted classifiers by correcting the bias brought by the unequal sample sizes. The bias-corrected LDA and RLDA classifiers are shown to have smaller misclassification rates than LDA and RLDA respectively. Several interesting examples are discussed in detail and the theoretical results on dimension effect are illustrated via extensive simulation studies.
Comments: 34pages,6figures
Subjects: Statistics Theory (math.ST)
Journal reference: Electronic Journal of Statistics,2018
DOI: 10.1214/18-EJS1469
Cite as: arXiv:1710.03136 [math.ST]
  (or arXiv:1710.03136v2 [math.ST] for this version)

Submission history

From: Cheng Wang [view email]
[v1] Mon, 9 Oct 2017 15:04:02 GMT (33kb,D)
[v2] Fri, 21 Sep 2018 01:11:04 GMT (152kb,D)

Link back to: arXiv, form interface, contact.