Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2011 Feb;11(1):23-5.
doi: 10.7861/clinmedicine.11-1-23.

Content validity of a clinical problem solving test for use in recruitment to the acute specialties

Gemma Crossingham  1 , Thomas Gale, Martin Roberts, Alison Carr, Jeremy Langton, Ian Anderson
Affiliations
Review

Content validity of a clinical problem solving test for use in recruitment to the acute specialties

Gemma Crossingham et al. Clin Med (Lond). 2011 Feb.

Abstract

Clinical problem solving tests (CPSTs) have been shown to be reliable and valid for recruitment to general practice (GP) training programmes. This article presents the results from a Department of Health-funded pilot into the use of a CPST designed for recruitment to the acute specialties (AS). The pilot paper consisted of 99 items from the validated GP question bank and 40 new items aimed specifically at topics of relevance to AS training. The CPST successfully differentiated between applicants. The overall test and the GP section showed high internal reliability, whereas the AS pilot section performed less well. A detailed item analysis revealed that the AS pilot items were, on average, more difficult and of poorer quality than the GP items. Important issues that need to be addressed in the early development phase of a test used for high stakes selection to specialty training programmes are discussed.

PubMed Disclaimer

Figures

Fig 1.
Fig 1.
Histograms of mean scores for appropriateness to selection awarded to acute specialty (AS) and general practice (GP) questions split by question source (n = 59 × 30 = 1,770).
See this image and copyright information in PMC

References

    1. Tooke J. Aspiring to excellence: findings and recommendations of the Independent Inquiry into Modernising Medical Careers. London: MMC Inquiry;
    1. Patterson F, Baron H, Carr V, Plint S, Lane P. Evaluation of three short-listing methodologies for selection into postgraduate training in general practice. Med Educ. 2009;43:50–7. doi: 10.1111/j.1365-2923.2008.03238.x. - DOI - PubMed
    1. Nunnally JC, Bernstein IH. Psychometric theory. 3rd edn. New York: McGraw-Hill; 1994.
    1. Carmichael KDMD, Westmoreland JBMD, Thomas JAMD, Patterson RMP. Relation of residency selection factors to subsequent orthopaedic in-training examination performance. Southern Med J. 2005;98:528–32. doi: 10.1097/01.SMJ.0000157560.75496.CB. - DOI - PubMed
    1. Matveevskii AS, Gravenstein N. Role of simulators, educational programs, and nontechnical skills in anesthesia resident selection, education, and competency assessment. J Crit Care. 2008;23:167–72. doi: 10.1016/j.jcrc.2007.11.009. - DOI - PubMed

Publication types

MeSH terms