We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: As easy as APC: overcoming missing data and class imbalance in time series with self-supervised learning

Abstract: High levels of missing data and strong class imbalance are ubiquitous challenges that are often presented simultaneously in real-world time series data. Existing methods approach these problems separately, frequently making significant assumptions about the underlying data generation process in order to lessen the impact of missing information. In this work, we instead demonstrate how a general self-supervised training method, namely Autoregressive Predictive Coding (APC), can be leveraged to overcome both missing data and class imbalance simultaneously without strong assumptions. Specifically, on a synthetic dataset, we show that standard baselines are substantially improved upon through the use of APC, yielding the greatest gains in the combined setting of high missingness and severe class imbalance. We further apply APC on two real-world medical time-series datasets, and show that APC improves the classification performance in all settings, ultimately achieving state-of-the-art AUPRC results on the Physionet benchmark.
Comments: Accepted to the NeurIPS 2021 Workshop on Self-Supervised Learning: Theory and Practice
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)
Cite as: arXiv:2106.15577 [cs.LG]
  (or arXiv:2106.15577v5 [cs.LG] for this version)

Submission history

From: Fiorella Wever [view email]
[v1] Tue, 29 Jun 2021 17:11:36 GMT (2361kb,D)
[v2] Wed, 27 Oct 2021 15:17:10 GMT (3503kb,D)
[v3] Sat, 4 Dec 2021 18:18:33 GMT (1973kb,D)
[v4] Tue, 7 Dec 2021 10:55:56 GMT (1973kb,D)
[v5] Wed, 26 Jan 2022 19:18:58 GMT (1973kb,D)

Link back to: arXiv, form interface, contact.