We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.AP

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: Distance for Functional Data Clustering Based on Smoothing Parameter Commutation

Abstract: We propose a novel method to determine the dissimilarity between subjects for functional data clustering. Spline smoothing or interpolation is common to deal with data of such type. Instead of estimating the best-representing curve for each subject as fixed during clustering, we measure the dissimilarity between subjects based on varying curve estimates with commutation of smoothing parameters pair-by-pair (of subjects). The intuitions are that smoothing parameters of smoothing splines reflect inverse signal-to-noise ratios and that applying an identical smoothing parameter the smoothed curves for two similar subjects are expected to be close. The effectiveness of our proposal is shown through simulations comparing to other dissimilarity measures. It also has several pragmatic advantages. First, missing values or irregular time points can be handled directly, thanks to the nature of smoothing splines. Second, conventional clustering method based on dissimilarity can be employed straightforward, and the dissimilarity also serves as a useful tool for outlier detection. Third, the implementation is almost handy since subroutines for smoothing splines and numerical integration are widely available. Fourth, the computational complexity does not increase and is parallel with that in calculating Euclidean distance between curves estimated by smoothing splines.
Subjects: Methodology (stat.ME); Applications (stat.AP); Machine Learning (stat.ML)
Journal reference: Statistical Methods in Medical Research, 27 (2018)
DOI: 10.1177/0962280217710050
Cite as: arXiv:1604.02668 [stat.ME]
  (or arXiv:1604.02668v1 [stat.ME] for this version)

Submission history

From: ShengLi Tzeng [view email]
[v1] Sun, 10 Apr 2016 10:55:52 GMT (74kb,D)

Link back to: arXiv, form interface, contact.