Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Jan;42(1):135-145.
doi: 10.1002/jum.16095. Epub 2022 Sep 27.

Development and Validation of a Point-of-Care-Ultrasound Image Quality Assessment Tool: The POCUS IQ Scale

Almaz S Dessie  1 , Aaron W Calhoun  2 , Panida Kanjanauptom  3 , Gregory E Gilbert  4   5 , Atim Ekpenyong  6 , Resa E Lewiss  7 , Joni E Rabiner  1 , Daniel S Tsze  1 , David O Kessler  1
Affiliations

Development and Validation of a Point-of-Care-Ultrasound Image Quality Assessment Tool: The POCUS IQ Scale

Almaz S Dessie et al. J Ultrasound Med. 2023 Jan.

Abstract

Objectives: We aimed to develop a standardized scoring tool to measure point-of-care ultrasound (POCUS) image quality and to determine validity evidence for its use to assess lung ultrasound image quality.

Methods: The POCUS Image Quality (POCUS IQ) scale was developed by POCUS-trained physicians to assess sonographers' image acquisition skills by evaluating image quality for any POCUS application. The scale was piloted using lung images of healthy standardized patients acquired by three expert sonographers compared to three novices before and after training. All images (experts, novices pre-training, novices post-training) were scored on the POCUS IQ scale by three blinded POCUS-trained physicians. Reliability was assessed with fully-crossed generalizability and decision studies. Validity was assessed using Messick's framework.

Results: Content validity was supported by the tool's development process of literature review, expert consensus, and pilot testing. Response process was supported by reviewer training and the blinded scoring process. Relation to other variables was supported by scores relating to sonographer experience: median expert score = 10.5/14 (IQR: 4), median novice pre-training score = 6/14 (IQR: 2.25), and novices' improvement after training (median post-training score = 12/14, IQR: 3.25). Internal structure was supported by internal consistency data (coefficient alpha = 0.84, omega coefficient = 0.91) and the generalizability study showing the main contributor to score variability was the sonographer (51%). The G-coefficient was 0.89, suggesting very good internal structure, however, Gwet's AC2 was 0.5, indicating moderate interrater reliability. The D study projected a minimum of 1 reviewer and 2 patients are needed for good psychometric reliability.

Conclusions: The POCUS scale has good preliminary validity evidence as an assessment tool for lung POCUS image acquisition skills. Further studies are needed to demonstrate its utility for other POCUS applications and as a feedback tool for POCUS learners.

Keywords: G study; bedside ultrasound; clinical ultrasound; competency assessment; generalizability theory; point-of-care ultrasound.

PubMed Disclaimer

References

    1. Tolsgaard MG, Todsen T, Sorensen JL, et al. International multispecialty consensus on how to evaluate ultrasound competence: a Delphi consensus survey. PLoS One 2013; 8:e57687.
    1. Marin JR, Abo AM, Doniger SJ, et al. Point-of-care ultrasonography by pediatric emergency physicians. Ann Emerg Med 2015; 65:472-478.
    1. Nelson M, Abdi A, Adhikari S, et al. Goal-directed focused ultrasound milestones revised: a multiorganizational consensus. Acad Emerg Med 2016; 23:1274-1279.
    1. Lewiss RE, Pearl M, Nomura JT, et al. CORD-AEUS: consensus document for the emergency ultrasound milestone project. Acad Emerg Med 2013; 20:740-745.
    1. Akhtar S, Theodoro D, Gaspari R, et al. Resident training in emergency ultrasound: consensus recommendations from the 2008 Council of Emergency Medicine Residency Directors Conference. Acad Emerg Med 2009; 16:S32-S36.

LinkOut - more resources