Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Feb;86(2):ajpe8511.
doi: 10.5688/ajpe8511. Epub 2021 Jul 22.

A Situational Judgment Test to Assess Students' Achievement of Accreditation Council for Pharmacy Education Standards 3 and 4

Teresa DeLellis  1 , Marwa Noureldin  2 , Sharon K Park  3 , Kelly M Shields  4 , Alicia Bryant  5 , Aleda M H Chen  6 , Heather Mw Petrelli  7
Affiliations

A Situational Judgment Test to Assess Students' Achievement of Accreditation Council for Pharmacy Education Standards 3 and 4

Teresa DeLellis et al. Am J Pharm Educ. 2022 Feb.

Abstract

Objective. For pharmacy students to successfully meet competencies related to Accreditation Council for Pharmacy Education Standards 3 and 4, it is essential for pharmacy programs to assess student progression in the affective domain. The purpose of this study was to develop and assess the validity of a situational judgment test (SJT) for evaluating student mastery of Standards 3 and 4.Methods. A multi-institutional faculty team developed an 18-item SJT that consisted of scenarios asking the respondent to rank the effectiveness of four response options mapped to Standards 3 and 4. The research team systematically reviewed the literature, created items, and deliberated until consensus was achieved. Subject matter experts (SMEs) reviewed and provided feedback on the instrument. Students from two institutions were recruited to participate in cognitive interviews about the finalized instrument. Cognitive interview data were analyzed to identify themes.Results. After edits were made to the instrument based on SME feedback, students (n=18) in the cognitive interviews identified item length as a concern and commented on item/response clarity and comprehensiveness. Data from the cognitive interviews were used to modify the SJT to reduce the length and clarify items. The result was two shorter versions of the instrument, both with similar mapping to all elements in Standards 3 and 4.Conclusion. Early steps in validating the SJT suggested that the instrument may be a promising tool to assess student progression in the affective domain. The SJT instrument is intended to provide evidence of student pharmacist development that occurs in the didactic, experiential, and co-curricular portions of pharmacy education. The instrument can serve as one part of a comprehensive assessment plan.

Keywords: ACPE standards; affective domain; co-curriculum; cognitive interviewing; situational judgment test; validity evidence.

PubMed Disclaimer

Figures

Figure 1.
Figure 1.
Overview of the development process of an situational judgement test (SJT) to assess ACPE Standards 3 and 4 Student Competencies.
See this image and copyright information in PMC

References

    1. Accreditation Council for Pharmacy Education. Accreditation standards and key elements for the professional program in pharmacy leading to the Doctor of Pharmacy degree: “Standards 2016”. Accessed November 17, 2020, https://www.acpe-accredit.org/pdf/Standards2016FINAL.pdf
    1. Medina MS, Plaza CM, Stowe CD, et al. . Center for the Advancement of Pharmacy Education 2013 educational outcomes. Am J Pharm Educ. 2013;77(8):162. doi: 10.5688/ajpe778162. - DOI - PMC - PubMed
    1. Maerten-Rivera JL, Chen AMH, Augustine J, et al. . Co-curriculum implementation and assessment in accredited Doctor of Pharmacy programs. Am J Pharm Educ. 2020;84(3):7569. doi:10.5688/ajpe7569 - DOI - PMC - PubMed
    1. Patterson F, Zibarras L, Ashworth V. Situational judgement tests in medical education and training: Research, theory and practice: AMEE Guide No. 100. Medical Teacher. 2016/01/02 2016;38(1):3-17. doi:10.3109/0142159X.2015.1072619 - DOI - PubMed
    1. Smith KJ, Flaxman C, Farland MZ et al. . Development and validation of a situational judgement test to assess professionalism. Am J Pharm Educ. 2020;84(7):7771. DOI: 10.5688/ajpe7771 - DOI - PMC - PubMed

LinkOut - more resources