Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2013 Nov-Dec;20(6):1067-75.
doi: 10.1136/amiajnl-2012-001503. Epub 2013 Jun 20.

Investigating the link between radiologists' gaze, diagnostic decision, and image content

Georgia Tourassi  1 , Sophie Voisin, Vincent Paquit, Elizabeth Krupinski
Affiliations

Investigating the link between radiologists' gaze, diagnostic decision, and image content

Georgia Tourassi et al. J Am Med Inform Assoc. 2013 Nov-Dec.

Abstract

Objective: To investigate machine learning for linking image content, human perception, cognition, and error in the diagnostic interpretation of mammograms.

Methods: Gaze data and diagnostic decisions were collected from three breast imaging radiologists and three radiology residents who reviewed 20 screening mammograms while wearing a head-mounted eye-tracker. Image analysis was performed in mammographic regions that attracted radiologists' attention and in all abnormal regions. Machine learning algorithms were investigated to develop predictive models that link: (i) image content with gaze, (ii) image content and gaze with cognition, and (iii) image content, gaze, and cognition with diagnostic error. Both group-based and individualized models were explored.

Results: By pooling the data from all readers, machine learning produced highly accurate predictive models linking image content, gaze, and cognition. Potential linking of those with diagnostic error was also supported to some extent. Merging readers' gaze metrics and cognitive opinions with computer-extracted image features identified 59% of the readers' diagnostic errors while confirming 97.3% of their correct diagnoses. The readers' individual perceptual and cognitive behaviors could be adequately predicted by modeling the behavior of others. However, personalized tuning was in many cases beneficial for capturing more accurately individual behavior.

Conclusions: There is clearly an interaction between radiologists' gaze, diagnostic decision, and image content which can be modeled with machine learning algorithms.

Keywords: eye-tracking; machine learning; mammography; user modeling.

PubMed Disclaimer

References

    1. Patel VL, Kaufman DR. Medical informatics and the science of cognition. J Am Med Inform Assoc 1998;5:493–502 - PMC - PubMed
    1. Patel VL, Arocha JF, Kaufman DR. A primer on aspects of cognition for medical informatics. J Am Med Inform Assoc 2001;8:324–43 - PMC - PubMed
    1. Krupinski EA. The importance of perception research in medical imaging. Radiat Med 2000;18:329–34 - PubMed
    1. Andriole KP. Addressing the coming radiology crisis—the Society for Computer Applications in Radiology Transforming the Radiological Interpretation Process (TRIP™) initiative. J Digit Imaging 2004;17:235–43 - PMC - PubMed
    1. Krupinski EA. Current perspectives in medical image perception. Atten Percept Psychophys 2010;72:1205–17 - PMC - PubMed

Publication types