We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.DS

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Data Structures and Algorithms

Title: Low-Rank Methods in Event Detection and Subsampled Point-to-Subspace Proximity Tests

Abstract: Monitoring of streamed data to detect abnormal behaviour (variously known as event detection, anomaly detection, change detection, or outlier detection) underlies many applications of the Internet of Things. There, one often collects data from a variety of sources, with asynchronous sampling, and missing data. In this setting, one can predict abnormal behavior using low-rank techniques. In particular, we assume that normal observations come from a low-rank subspace, prior to being corrupted by a uniformly distributed noise. Correspondingly, we aim to recover a representation of the subspace, and perform event detection by running point-to-subspace distance query for incoming data. In particular, we use a variant of low-rank factorisation, which considers interval uncertainty sets around "known entries", on a suitable flattening of the input data to obtain a low-rank model. On-line, we compute the distance of incoming data to the low-rank normal subspace and update the subspace to keep it consistent with the seasonal changes present. For the distance computation, we suggest to consider subsampling. We bound the one-sided error as a function of the number of coordinates employed using techniques from learning theory and computational geometry. In our experimental evaluation, we have tested the ability of the proposed algorithm to identify samples of abnormal behavior in induction-loop data from Dublin, Ireland.
Subjects: Data Structures and Algorithms (cs.DS); Computational Geometry (cs.CG)
Journal reference: IEEE Access, 2022
DOI: 10.1109/ACCESS.2022.3152206
Cite as: arXiv:1802.03649 [cs.DS]
  (or arXiv:1802.03649v3 [cs.DS] for this version)

Submission history

From: Jakub Marecek [view email]
[v1] Sat, 10 Feb 2018 20:32:28 GMT (1056kb,D)
[v2] Fri, 5 Mar 2021 12:07:24 GMT (847kb,D)
[v3] Thu, 29 Jul 2021 18:59:14 GMT (848kb,D)

Link back to: arXiv, form interface, contact.