Current browse context:
stat.ME
Change to browse by:
References & Citations
Statistics > Methodology
Title: An Efficient $k$-modes Algorithm for Clustering Categorical Datasets
(Submitted on 6 Jun 2020 (v1), revised 15 Nov 2020 (this version, v2), latest version 23 Jun 2021 (v3))
Abstract: Mining clusters from datasets is an important endeavor in many applications. The $k$-means algorithm is a popular and efficient, distribution-free approach for clustering numerical-valued data, but does not apply for categorical-valued observations. The $k$-modes algorithm addresses this lacuna by replacing the Euclidean distance with the Hamming distance and the means with the modes in the $k$-means objective function. We provide a novel, computationally efficient implementation of $k$-modes, called OTQT. We prove that OTQT finds updates, undetectable to existing $k$-modes algorithms, that improve the objective function. Thus, although slightly slower per iteration owing to its algorithmic complexity, OTQT is always more accurate per iteration and almost always faster (and only barely slower on some datasets) to the final optimum. As a result, we recommend OTQT as the preferred, default algorithm for all $k$-modes implementations. We also examine five initialization methods and three types of $K$-selection methods, many of them novel or novel applications to $k$-modes. By examining performance on real and simulated datasets, we show that simple random initialization is the best initializer and that a novel $K$-selection method is more accurate than methods adapted from $k$-means.
Submission history
From: Ranjan Maitra [view email][v1] Sat, 6 Jun 2020 18:41:36 GMT (1863kb,D)
[v2] Sun, 15 Nov 2020 05:32:31 GMT (2289kb,D)
[v3] Wed, 23 Jun 2021 20:18:20 GMT (278kb,D)
Link back to: arXiv, form interface, contact.