Current browse context:
stat
Change to browse by:
References & Citations
Statistics > Methodology
Title: Hierarchical clustering: visualization, feature importance and model selection
(Submitted on 30 Nov 2021 (v1), last revised 28 Jan 2023 (this version, v2))
Abstract: We propose methods for the analysis of hierarchical clustering that fully use the multi-resolution structure provided by a dendrogram. Specifically, we propose a loss for choosing between clustering methods, a feature importance score and a graphical tool for visualizing the segmentation of features in a dendrogram. Current approaches to these tasks lead to loss of information since they require the user to generate a single partition of the instances by cutting the dendrogram at a specified level. Our proposed methods, instead, use the full structure of the dendrogram. The key insight behind the proposed methods is to view a dendrogram as a phylogeny. This analogy permits the assignment of a feature value to each internal node of a tree through an evolutionary model. Real and simulated datasets provide evidence that our proposed framework has desirable outcomes and gives more insights than state-of-art approaches. We provide an R package that implements our methods.
Submission history
From: Rafael Stern [view email][v1] Tue, 30 Nov 2021 20:38:17 GMT (1959kb,D)
[v2] Sat, 28 Jan 2023 03:50:27 GMT (2008kb,D)
Link back to: arXiv, form interface, contact.