References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: RATCHET: Medical Transformer for Chest X-ray Diagnosis and Reporting
(Submitted on 5 Jul 2021 (v1), last revised 15 Sep 2021 (this version, v2))
Abstract: Chest radiographs are one of the most common diagnostic modalities in clinical routine. It can be done cheaply, requires minimal equipment, and the image can be diagnosed by every radiologists. However, the number of chest radiographs obtained on a daily basis can easily overwhelm the available clinical capacities. We propose RATCHET: RAdiological Text Captioning for Human Examined Thoraces. RATCHET is a CNN-RNN-based medical transformer that is trained end-to-end. It is capable of extracting image features from chest radiographs, and generates medically accurate text reports that fit seamlessly into clinical work flows. The model is evaluated for its natural language generation ability using common metrics from NLP literature, as well as its medically accuracy through a surrogate report classification task. The model is available for download at: this http URL
Submission history
From: Benjamin Hou [view email][v1] Mon, 5 Jul 2021 15:58:48 GMT (3785kb,D)
[v2] Wed, 15 Sep 2021 12:42:45 GMT (3785kb,D)
Link back to: arXiv, form interface, contact.