We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Quantitative Biology > Quantitative Methods

Title: Dreem Open Datasets: Multi-Scored Sleep Datasets to compare Human and Automated sleep staging

Abstract: Sleep stage classification constitutes an important element of sleep disorder diagnosis. It relies on the visual inspection of polysomnography records by trained sleep technologists. Automated approaches have been designed to alleviate this resource-intensive task. However, such approaches are usually compared to a single human scorer annotation despite an inter-rater agreement of about 85 % only. The present study introduces two publicly-available datasets, DOD-H including 25 healthy volunteers and DOD-O including 55 patients suffering from obstructive sleep apnea (OSA). Both datasets have been scored by 5 sleep technologists from different sleep centers. We developed a framework to compare automated approaches to a consensus of multiple human scorers. Using this framework, we benchmarked and compared the main literature approaches. We also developed and benchmarked a new deep learning method, SimpleSleepNet, inspired by current state-of-the-art. We demonstrated that many methods can reach human-level performance on both datasets. SimpleSleepNet achieved an F1 of 89.9 % vs 86.8 % on average for human scorers on DOD-H, and an F1 of 88.3 % vs 84.8 % on DOD-O. Our study highlights that using state-of-the-art automated sleep staging outperforms human scorers performance for healthy volunteers and patients suffering from OSA. Consideration could be made to use automated approaches in the clinical setting.
Comments: 10 pages, journal submitted
Subjects: Quantitative Methods (q-bio.QM); Machine Learning (cs.LG); Signal Processing (eess.SP); Machine Learning (stat.ML)
Cite as: arXiv:1911.03221 [q-bio.QM]
  (or arXiv:1911.03221v4 [q-bio.QM] for this version)

Submission history

From: Valentin Thorey [view email]
[v1] Thu, 31 Oct 2019 16:12:43 GMT (2121kb,D)
[v2] Tue, 12 Nov 2019 17:21:23 GMT (2121kb,D)
[v3] Mon, 2 Mar 2020 16:53:12 GMT (2124kb,D)
[v4] Mon, 27 Apr 2020 09:45:45 GMT (2122kb,D)

Link back to: arXiv, form interface, contact.