Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Dec 1;17(6):357-365.
doi: 10.1097/SIH.0000000000000667. Epub 2022 Apr 24.

Preparing and Presenting Validation Studies: A Guide for the Perplexed

Aaron W Calhoun  1 , Mark W Scerbo
Affiliations

Preparing and Presenting Validation Studies: A Guide for the Perplexed

Aaron W Calhoun et al. Simul Healthc. .

Abstract

Simulated environments are frequently used for learner assessment, and a wide array of assessment instruments have been created to assist with this process. It is important, therefore, that clear, compelling evidence for the validity of these assessments be established. Contemporary theory recognizes instrument validity as a unified construct that links a construct to be assessed with a population, an environment of assessment, and a decision to be made using the scores. In this article, we present a primer on 2 current frameworks (Messick and Kane), define the elements of each, present a rubric that can be used by potential authors to structure their work, and offer examples of published studies showing how each framework has been successfully used to make a validity argument. We offer this with the goal of improving the quality of validity-related publications, thereby advancing the quality of assessment in healthcare simulation.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflict of interest.

References

    1. Doughty CB, Kessler DO, Zuckerbraun NS, et al. Simulation in pediatric emergency medicine fellowships. Pediatrics 2015;136(1):e152–e158.
    1. Spillane L, Hayden E, Fernandez R, et al. The assessment of individual cognitive expertise and clinical competency: a research agenda. Acad Emerg Med 2008;15(11):1071–1078.
    1. Brett-Fleegler MB, Vinci RJ, Weiner DL. A simulator-based tool that assesses pediatric resident resuscitation competency. Pediatrics 2008;121:e597–e603.
    1. Calhoun AW, Boone M, Miller KH, Taulbee RL, Montgomery VL, Boland K. A multirater instrument for the assessment of simulated pediatric crises. J Grad Med Educ 2011;3(1):88–94.
    1. Cooper S, Cant R, Porter J, et al. Rating medical emergency teamwork performance: development of the Team Emergency Assessment Measure (TEAM). Resuscitation 2010;81(4):446–452.

LinkOut - more resources