Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2017;22(1):1324718.
doi: 10.1080/10872981.2017.1324718.

Medical students review of formative OSCE scores, checklists, and videos improves with student-faculty debriefing meetings

Aaron W Bernard  1 , Gabbriel Ceccolini  1 , Richard Feinn  1 , Jennifer Rockfeld  1 , Ilene Rosenberg  1 , Listy Thomas  1 , Todd Cassese  1
Affiliations

Medical students review of formative OSCE scores, checklists, and videos improves with student-faculty debriefing meetings

Aaron W Bernard et al. Med Educ Online. 2017.

Abstract

Background: Performance feedback is considered essential to clinical skills development. Formative objective structured clinical exams (F-OSCEs) often include immediate feedback by standardized patients. Students can also be provided access to performance metrics including scores, checklists, and video recordings after the F-OSCE to supplement this feedback. How often students choose to review this data and how review impacts future performance has not been documented.

Objective: We suspect student review of F-OSCE performance data is variable. We hypothesize that students who review this data have better performance on subsequent F-OSCEs compared to those who do not. We also suspect that frequency of data review can be improved with faculty involvement in the form of student-faculty debriefing meetings.

Design: Simulation recording software tracks and time stamps student review of performance data. We investigated a cohort of first- and second-year medical students from the 2015-16 academic year. Basic descriptive statistics were used to characterize frequency of data review and a linear mixed-model analysis was used to determine relationships between data review and future F-OSCE performance.

Results: Students reviewed scores (64%), checklists (42%), and videos (28%) in decreasing frequency. Frequency of review of all metric and modalities improved when student-faculty debriefing meetings were conducted (p<.001). Among 92 first-year students, checklist review was associated with an improved performance on subsequent F-OSCEs (p = 0.038) by 1.07 percentage points on a scale of 0-100. Among 86 second year students, no review modality was associated with improved performance on subsequent F-OSCEs.

Conclusion: Medical students review F-OSCE checklists and video recordings less than 50% of the time when not prompted. Student-faculty debriefing meetings increased student data reviews. First-year student's review of checklists on F-OSCEs was associated with increases in performance on subsequent F-OSCEs, however this outcome was not observed among second-year students.

Keywords: OSCE; clinical skills; feedback; self-assessment; video review SP: Standardized patient.

PubMed Disclaimer

References

    1. Ericsson KA, Krampe RT, Tesch-Romer C.. The role of deliberate practice in the acquisition of expert performance. Psychol Rev. 1993;100:363–5.
    1. Ericsson KA. Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med. 2004;79:S70–S81. - PubMed
    1. Ende J. Feedback in clinical medical education. JAMA. 1983;250:777–781. - PubMed
    1. Bernard AW, Kman NE, Khandelwal S. Feedback in the emergency medicine clerkship. West J Emerg Med. 2011;12(4):537–542. - PMC - PubMed
    1. Bernard AW, Gorgas D, Greenberger S, et al. The use of reflection in emergency medicine education. Acad Emerg Med. 2012;19(8):978–982. - PubMed

LinkOut - more resources