An Objective Structured Clinical Examination to Assess Competency Acquired During an Introductory Pharmacy Practice Experience

Abstract

Objective. To evaluate the use of an objective structured clinical examinations (OSCE) to assess clinical competency acquired during an off-campus introductory pharmacy practice experience (IPPE). Methods. Third-year pharmacy students completed an IPPE in transitions of care and completed 24 experiential contact hours at one of 17 practice sites. Students were assessed using two OSCEs, the first occurring prior to beginning an off-site IPPE (pre-experience OSCE) and the second occurring after completion of the off-site IPPE (post-experience OSCE). Each OSCE consisted of 10 stations and covered five graded competency domains. The primary outcome was the degree of change in student performance from the pre-experience OSCE to the post-experience OSCE. Secondary outcomes included changes in each graded domain, OSCE pass rate, and failure conversion rate. Results. Of 111 students, 109 completed both the pre- and post-experience OSCE. Significant improvements were observed in overall score and cohort pass rate. Overall scores improved from 80 for the pre-experience OSCE to 87 for the post-experience OSCE. The OSCE pass rate also improved from 47% to 84%. Conclusion. Although preceptor evaluations have traditionally served as the primary summative assessment for IPPE and APPE, this study indicates that OSCEs may be a reliable alternative to assess clinical competency acquired from off-site practice experiences.

Keywords: clinical competency; competency assessment; experiential education; introductory pharmacy practice experience; objective structured clinical examination.