We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Validation of cluster analysis results on validation data: A systematic framework

Authors: Theresa Ullmann (1), Christian Hennig (2), Anne-Laure Boulesteix (1) ((1) Institute for Medical Information Processing, Biometry and Epidemiology, LMU Munich, Germany, (2) Dipartimento di Scienze Statistiche "Paolo Fortunati", Universita di Bologna, Italy)
Abstract: Cluster analysis refers to a wide range of data analytic techniques for class discovery and is popular in many application fields. To judge the quality of a clustering result, different cluster validation procedures have been proposed in the literature. While there is extensive work on classical validation techniques, such as internal and external validation, less attention has been given to validating and replicating a clustering result using a validation dataset. Such a dataset may be part of the original dataset, which is separated before analysis begins, or it could be an independently collected dataset. We present a systematic structured framework for validating clustering results on validation data that includes most existing validation approaches. In particular, we review classical validation techniques such as internal and external validation, stability analysis, hypothesis testing, and visual validation, and show how they can be interpreted in terms of our framework. We precisely define and formalise different types of validation of clustering results on a validation dataset and explain how each type can be implemented in practice. Furthermore, we give examples of how clustering studies from the applied literature that used a validation dataset can be classified into the framework.
Comments: 32 pages, 1 figure
Subjects: Methodology (stat.ME)
Cite as: arXiv:2103.01281 [stat.ME]
  (or arXiv:2103.01281v1 [stat.ME] for this version)

Submission history

From: Theresa Ullmann [view email]
[v1] Mon, 1 Mar 2021 19:53:59 GMT (63kb)

Link back to: arXiv, form interface, contact.