Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2020 Jul;84(7):ajpe7771.
doi: 10.5688/ajpe7771.

Development and Validation of a Situational Judgement Test to Assess Professionalism

Kathryn J Smith  1 , Charlotte Flaxman  2 , Michelle Z Farland  1 , Aaron Thomas  1 , Shauna M Buring  1 , Karen Whalen  1 , Fiona Patterson  2
Affiliations

Development and Validation of a Situational Judgement Test to Assess Professionalism

Kathryn J Smith et al. Am J Pharm Educ. 2020 Jul.

Abstract

Objective. The purpose of this study was to develop, pilot, and validate a situational judgement test (SJT) to assess professionalism in Doctor of Pharmacy (PharmD) students. Methods. Test specifications were developed and faculty members were educated on best practices in item writing for SJTs. The faculty members then developed 75 pilot scenarios. From those, two versions of the SJT, each containing 25 scenarios, were created. The pilot population for the SJT was student pharmacists in their third professional year, just prior to starting their advanced pharmacy practice experiences. The students completed the two versions of the test on different days, approximately 48 hours apart, with 50 minutes allowed to complete each. Subsequently, students completed a questionnaire regarding the SJT at the conclusion of the second test. Results. Version 1 of the SJT was completed by 228 students, and version 2 was completed by 225 students. Mean scores were 390 (SD=20, range 318-429) and 342 (SD=21, range 263-387) on test versions 1 and 2, respectively. The reliability of the tests was appropriate (test version 1, α=0.77; test version 2, α=0.79). Students felt that the content of the tests was realistic with respect to pharmacy practice (90.1%), and that the tests gave them an opportunity to reflect on how to approach challenging situations (82.6%). Conclusion. We developed a reliable SJT to assess professionalism in PharmD students. Future research should focus on creating a personalized learning plan for students who do not meet minimum performance standards on this SJT.

Keywords: affective; assessment; professional attributes; professionalism; situational judgement test.

PubMed Disclaimer

References

    1. Accreditation standards and key elements for the professional program in pharmacy leading to the doctor of pharmacy degree, 2016. Accreditation Council for Pharmacy Education; Chicago, IL: https://www.acpe-accredit.org/pdf/Standards2016FINAL.pdf. Accessed June 19, 2020.
    1. Medina MS, Plaza CM, Stowe CD, et al. Center for the Advancement of Pharmacy Education 2013 Educational Outcomes. Am J Pharm Educ. 2013;77(8):Article 162. - PMC - PubMed
    1. Bloom BS. ed. Taxonomy of Educational Objectives. The Classification of Educational Goals. Handbook I: Cognitive Domain. New York, NY: McKay; 1956.
    1. Anderson L, Krathwohl D, eds. A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives. 1st ed. London, England: Longman; 2001.
    1. Patterson F, Knight A, Dowell J, et al. How effective are selection methods in medical education and training? a systematic review. Med Educ. 2016;50(1):36-60. - PubMed

LinkOut - more resources