Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2019 Apr;11(2):214-220.
doi: 10.4300/JGME-D-18-00601.2.

Assessing Entrustable Professional Activities Using an Orientation OSCE: Identifying the Gaps

Sheena CarlLee, Jane Rowat, Manish Suneja

Assessing Entrustable Professional Activities Using an Orientation OSCE: Identifying the Gaps

Sheena CarlLee et al. J Grad Med Educ. 2019 Apr.

Abstract

Background: A residency program's intern cohort is comprised of individuals from different medical schools that place varying levels of emphasis on Core Entrustable Professional Activities for Entering Residency (CEPAERs). Program directors have expressed concerns about the preparedness of medical school graduates. Though guiding principles for implementation of the CEPAERs have been published, studies using this framework to assess interns' baseline skills during orientation are limited.

Objective: A CEPAER-based objective structured clinical examination (OSCE) was implemented with the aims to (1) assess each intern's baseline clinical skills and provide formative feedback; (2) determine an intern's readiness for resident responsibilities; (3) inform individualized education plans; and (4) address identified gaps through curricular change.

Methods: During orientation, all 33 interns from internal medicine (categorical, preliminary, and medicine-psychiatry) participated in the OSCE. Six 20-minute stations evaluated 8 EPAs. Faculty completed a global assessment, and standardized patients completed a communications checklist and global assessment. All interns completed a self-assessment of baseline skills and a post-OSCE survey.

Results: Stations assessing handoffs, informed consent, and subjective, objective, assessment, and plan (SOAP) note were the lowest-performing stations. Interns performed lower in skills for which they did not report previous training. Formal instruction was incorporated into didactic sessions for the lowest-performing stations. The majority of interns indicated that the assessment was useful, and immediate feedback was beneficial.

Conclusions: This OSCE during orientation offers just-in-time baseline information regarding interns' critical skills and may lead to individualized feedback as well as continuous curricular improvement.

PubMed Disclaimer

Conflict of interest statement

Conflict of interest: The authors declare they have no competing interests.

Figures

Figure 1A
Figure 1A
OSCE Stations
Figure 1B
Figure 1B
Entrustable Professional Activities Assessed During Intern Orientation
Figures 2A and 2B
Figures 2A and 2B
Intern Performance in OSCE Stations
Figure 3A
Figure 3A
Intern Evaluation of OSCE
Figure 3B
Figure 3B
Intern-Reported Prior EPA Skill Training
Figure 3C
Figure 3C
Representative Intern Comments Organized by Themes From Post-OSCE Survey
See this image and copyright information in PMC

References

    1. O'Brien BC. What to do about the transition to residency? Exploring problems and solutions from three perspectives. Acad Med. 2018;93(5):681–684. doi: 10.1097/ACM.0000000000002150. - DOI - PubMed
    1. Englander R, Flynn T, Call S, Carraccio C, Cleary L, Fulton TB, et al. Toward defining the foundation of the MD degree: core entrustable professional activities for entering residency. Acad Med. 2016;91(10):1352–1358. doi: 10.1097/ACM.0000000000001204. - DOI - PubMed
    1. Brown DR, Warren JB, Hyderi A, Drusin RE, Moeller J, Rosenfeld M, et al. Finding a path to entrustment in undergraduate medical education: a progress report from the AAMC Core Entrustable Professional Activities for Entering Residency Entrustment Concept Group. Acad Med. 2017;92(6):774–779. doi: 10.1097/ACM.0000000000001544. - DOI - PubMed
    1. Lomis K, Amiel JM, Ryan MS, Esposito K, Green M, Stagnaro-Green A, et al. Implementing an entrustable professional activities framework in undergraduate medical education: early lessons from the AAMC Core Entrustable Professional Activities for Entering Residency pilot. Acad Med. 2017;92(6):765–770. doi: 10.1097/ACM.0000000000001543. - DOI - PubMed
    1. Lypson ML, Frohna JG, Gruppen LD, Woolliscroft JO. Assessing residents' competencies at baseline: identifying the gaps. Acad Med. 2004;79(6):564–570. - PubMed

LinkOut - more resources