We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: A new measure for assessment of clustering based on kernel density estimation

Authors: Soumita Modak
Abstract: A new clustering accuracy measure is proposed to determine the unknown number of clusters and to assess the quality of clustering of a data set given in any dimensional space. Our validity index applies the classical nonparametric univariate kernel density estimation method to the interpoint distances computed between the members of data. Being based on interpoint distances, it is free of the curse of dimensionality and therefore efficiently computable for high-dimensional situations where the number of study variables can be larger than the sample size. The proposed measure is compatible with any clustering algorithm and with every kind of data set where the interpoint distance measure can be defined to have a density function. Simulation study proves its superiority over widely used cluster validity indices like the average silhouette width and the Dunn index, whereas its applicability is shown with respect to a high-dimensional Biostatistical study of Alon data set and a large Astrostatistical application of time series with light curves of new variable stars.
Comments: 16 pages
Subjects: Methodology (stat.ME); Applications (stat.AP)
MSC classes: 62H30
ACM classes: G.3; I.5.3
Journal reference: Communications in Statistics - Theory and Methods (2022)
DOI: 10.1080/03610926.2022.2032168
Cite as: arXiv:2201.02030 [stat.ME]
  (or arXiv:2201.02030v2 [stat.ME] for this version)

Submission history

From: Soumita Modak Ph.D. [view email]
[v1] Thu, 6 Jan 2022 12:43:40 GMT (10kb)
[v2] Sun, 13 Feb 2022 14:44:34 GMT (10kb)

Link back to: arXiv, form interface, contact.