We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: Detecting and Classifying Outliers in Big Functional Data

Abstract: We propose two new outlier detection methods, for identifying and classifying different types of outliers in (big) functional data sets. The proposed methods are based on an existing method called Massive Unsupervised Outlier Detection (MUOD). MUOD detects and classifies outliers by computing for each curve, three indices, all based on the concept of linear regression and correlation, which measure outlyingness in terms of shape, magnitude and amplitude, relative to the other curves in the data. 'Semifast-MUOD', the first method, uses a sample of the observations in computing the indices, while 'Fast-MUOD', the second method, uses the point-wise or $L_1$ median in computing the indices. The classical boxplot is used to separate the indices of the outliers from those of the typical observations. Performance evaluation of the proposed methods using simulated data show significant improvements compared to MUOD, both in outlier detection and computational time. We show that Fast-MUOD is especially well suited to handling big and dense functional datasets with very small computational time compared to other methods. Further comparisons with some recent outlier detection methods for functional data also show superior or comparable outlier detection accuracy of the proposed methods. We apply the proposed methods on weather, population growth, and video data.
Subjects: Methodology (stat.ME); Applications (stat.AP)
MSC classes: 2R10 (Functional data analysis)
DOI: 10.1007/s11634-021-00460-9
Cite as: arXiv:1912.07287 [stat.ME]
  (or arXiv:1912.07287v3 [stat.ME] for this version)

Submission history

From: Oluwasegun Ojo [view email]
[v1] Mon, 16 Dec 2019 10:52:27 GMT (3861kb,D)
[v2] Tue, 11 May 2021 18:26:55 GMT (4213kb,D)
[v3] Thu, 14 Oct 2021 14:11:18 GMT (5939kb,D)

Link back to: arXiv, form interface, contact.