We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Applications

Title: Diagnosis Prevalence vs. Efficacy in Machine-learning Based Diagnostic Decision Support

Abstract: Many recent studies use machine learning to predict a small number of ICD-9-CM codes. In practice, on the other hand, physicians have to consider a broader range of diagnoses. This study aims to put these previously incongruent evaluation settings on a more equal footing by predicting ICD-9-CM codes based on electronic health record properties and demonstrating the relationship between diagnosis prevalence and system performance. We extracted patient features from the MIMIC-III dataset for each admission. We trained and evaluated 43 different machine learning classifiers. Among this pool, the most successful classifier was a Multi-Layer Perceptron. In accordance with general machine learning expectation, we observed all classifiers' F1 scores to drop as disease prevalence decreased. Scores fell from 0.28 for the 50 most prevalent ICD-9-CM codes to 0.03 for the 1000 most prevalent ICD-9-CM codes. Statistical analyses showed a moderate positive correlation between disease prevalence and efficacy (0.5866).
Comments: AMIA Joint Summits in Translational Science, 2020
Subjects: Applications (stat.AP); Information Retrieval (cs.IR); Machine Learning (cs.LG)
Cite as: arXiv:2006.13737 [stat.AP]
  (or arXiv:2006.13737v1 [stat.AP] for this version)

Submission history

From: Carsten Eickhoff [view email]
[v1] Wed, 24 Jun 2020 13:52:04 GMT (264kb)

Link back to: arXiv, form interface, contact.