We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.SD

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Sound

Title: COVID-19 Detection in Cough, Breath and Speech using Deep Transfer Learning and Bottleneck Features

Abstract: We present an experimental investigation into the effectiveness of transfer learning and bottleneck feature extraction in detecting COVID-19 from audio recordings of cough, breath and speech.
This type of screening is non-contact, does not require specialist medical expertise or laboratory facilities and can be deployed on inexpensive consumer hardware.
We use datasets that contain recordings of coughing, sneezing, speech and other noises, but do not contain COVID-19 labels, to pre-train three deep neural networks: a CNN, an LSTM and a Resnet50.
These pre-trained networks are subsequently either fine-tuned using smaller datasets of coughing with COVID-19 labels in the process of transfer learning, or are used as bottleneck feature extractors.
Results show that a Resnet50 classifier trained by this transfer learning process delivers optimal or near-optimal performance across all datasets achieving areas under the receiver operating characteristic (ROC AUC) of 0.98, 0.94 and 0.92 respectively for all three sound classes (coughs, breaths and speech).
This indicates that coughs carry the strongest COVID-19 signature, followed by breath and speech.
Our results also show that applying transfer learning and extracting bottleneck features using the larger datasets without COVID-19 labels led not only to improve performance, but also to minimise the standard deviation of the classifier AUCs among the outer folds of the leave-$p$-out cross-validation, indicating better generalisation.
We conclude that deep transfer learning and bottleneck feature extraction can improve COVID-19 cough, breath and speech audio classification, yielding automatic classifiers with higher accuracy.
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
Journal reference: Computers in Biology and Medicine, 2022
DOI: 10.1016/j.compbiomed.2021.105153
Cite as: arXiv:2104.02477 [cs.SD]
  (or arXiv:2104.02477v4 [cs.SD] for this version)

Submission history

From: Madhurananda Pahar [view email]
[v1] Fri, 2 Apr 2021 23:21:24 GMT (5537kb,D)
[v2] Mon, 12 Apr 2021 22:14:59 GMT (5536kb,D)
[v3] Tue, 27 Jul 2021 15:03:56 GMT (12223kb,D)
[v4] Wed, 18 Aug 2021 00:16:14 GMT (9937kb,D)

Link back to: arXiv, form interface, contact.