We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Ancillary-file links:

Ancillary files (details):

Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Electrical Engineering and Systems Science > Image and Video Processing

Title: REFLACX, a dataset of reports and eye-tracking data for localization of abnormalities in chest x-rays

Abstract: Deep learning has shown recent success in classifying anomalies in chest x-rays, but datasets are still small compared to natural image datasets. Supervision of abnormality localization has been shown to improve trained models, partially compensating for dataset sizes. However, explicitly labeling these anomalies requires an expert and is very time-consuming. We propose a potentially scalable method for collecting implicit localization data using an eye tracker to capture gaze locations and a microphone to capture a dictation of a report, imitating the setup of a reading room. The resulting REFLACX (Reports and Eye-Tracking Data for Localization of Abnormalities in Chest X-rays) dataset was labeled across five radiologists and contains 3,032 synchronized sets of eye-tracking data and timestamped report transcriptions for 2,616 chest x-rays from the MIMIC-CXR dataset. We also provide auxiliary annotations, including bounding boxes around lungs and heart and validation labels consisting of ellipses localizing abnormalities and image-level labels. Furthermore, a small subset of the data contains readings from all radiologists, allowing for the calculation of inter-rater scores.
Comments: Supplementary material included as ancillary files. Update: added clarifications and a graph showing the time correlation between gaze and report correlation
Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2109.14187 [eess.IV]
  (or arXiv:2109.14187v2 [eess.IV] for this version)

Submission history

From: Ricardo Bigolin Lanfredi [view email]
[v1] Wed, 29 Sep 2021 04:14:16 GMT (15164kb,AD)
[v2] Tue, 12 Apr 2022 18:11:20 GMT (19046kb,AD)

Link back to: arXiv, form interface, contact.