Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Apr;64(4):735-743.
doi: 10.1007/s00234-021-02826-4. Epub 2021 Oct 8.

Validation of an artificial intelligence solution for acute triage and rule-out normal of non-contrast CT head scans

Tom Dyer  1 , Sanjiv Chawda  2 , Raed Alkilani  2 , Tom Naunton Morgan  3 , Mike Hughes  3 , Simon Rasalingham  3
Affiliations

Validation of an artificial intelligence solution for acute triage and rule-out normal of non-contrast CT head scans

Tom Dyer et al. Neuroradiology. 2022 Apr.

Abstract

Purpose: Non-contrast CT head scans provide rapid and accurate diagnosis of acute head injury; however, increased utilisation of CT head scans makes it difficult to prioritise acutely unwell patients and places pressure on busy emergency departments (EDs). This study validates an AI algorithm to triage patients presenting with Intracranial Haemorrhage (ICH) or Acute Infarct whilst also identifying a subset of patients as Normal, with the potential to function as a rule-out test.

Methods: In total, 390 CT head scans were collected from 3 institutions in the UK, US and India. Ground-truth labels were assigned by 3 FRCR consultant radiologists. AI performance, as well as the performance of 3 independent radiologists, was measured against ground-truth labels.

Results: The algorithm showed AUC values of 0.988 (0.978-0.994), 0.933 (0.901-0.961) and 0.939 (0.919-0.958) for ICH, Acute Infarct and Normal, respectively. Sensitivity/specificity for ICH and Acute Infarct were 0.988/0.925 and 0.833/0.927, respectively, compared to 0.907/0.991 and 0.618/0.977 for radiologists. AI rule-out of Normal scans achieved 0.93% negative predictive value (NPV) for the removal of 54.3% of Normal cases, compared to 86.8% NPV for radiologists.

Conclusion: We show our algorithm can provide effective triage of ICH and Acute Infarct to prioritise acutely unwell patients. AI can also benefit clinical accuracy, with the algorithm identifying 91.3% of radiologist false negatives for ICH and 69.1% for Acute Infarct. Rule-out of Normal scans has huge potential for workload management in busy EDs, in this case removing 27.4% of all scans with no acute findings missed.

Keywords: AI; CT head; Diagnostic; Rule-out normal.

PubMed Disclaimer

References

    1. Klang E et al (2017) Overuse of head CT examinations for the investigation of minor head trauma: analysis of contributing factors. J Am Coll Radiol 14(2):171–176. https://doi.org/10.1016/j.jacr.2016.08.032 - DOI - PubMed
    1. Coles JP (2007) Imaging after brain injury. Br J Anaesth 99(1):49–60. https://doi.org/10.1093/bja/aem141 - DOI - PubMed
    1. Saver JL (2006) Time is brain - quantified. Stroke 37(1):263–266. https://doi.org/10.1161/01.STR.0000196957.55928.ab - DOI - PubMed
    1. Jovin TG et al (2015) Thrombectomy within 8 hours after symptom onset in ischemic stroke. N Engl J Med 372(24):2296–2306. https://doi.org/10.1056/nejmoa1503780 - DOI - PubMed
    1. Sauser K, Levine DA, Nickles AV, Reeves MJ (2014) Hospital variation in thrombolysis times among patients with acute ischemic stroke: the contributions of door-to-imaging time and imaging-to-needle time. JAMA Neurol 71(9):1155–1161. https://doi.org/10.1001/jamaneurol.2014.1528 - DOI - PubMed

LinkOut - more resources