Current browse context:
stat.ME
Change to browse by:
References & Citations
Statistics > Methodology
Title: Non-Parametric Cluster Significance Testing with Reference to a Unimodal Null Distribution
(Submitted on 5 Oct 2016 (v1), last revised 6 Oct 2016 (this version, v2))
Abstract: Cluster analysis is an unsupervised learning strategy that can be employed to identify subgroups of observations in data sets of unknown structure. This strategy is particularly useful for analyzing high-dimensional data such as microarray gene expression data. Many clustering methods are available, but it is challenging to determine if the identified clusters represent distinct subgroups. We propose a novel strategy to investigate the significance of identified clusters by comparing the within- cluster sum of squares from the original data to that produced by clustering an appropriate unimodal null distribution. The null distribution we present for this problem uses kernel density estimation and thus does not require that the data follow any particular distribution. We find that our method can accurately test for the presence of clustering even when the number of features is high.
Submission history
From: Erika Helgeson [view email][v1] Wed, 5 Oct 2016 14:01:57 GMT (1522kb,AD)
[v2] Thu, 6 Oct 2016 00:18:17 GMT (1747kb,AD)
Link back to: arXiv, form interface, contact.