Feedback in formative OSCEs: comparison between direct observation and video-based formats
- PMID: 27834170
- PMCID: PMC5103667
- DOI: 10.3402/meo.v21.32160
Feedback in formative OSCEs: comparison between direct observation and video-based formats
Abstract
Introduction: Medical students at the Faculty of Medicine, University of Geneva, Switzerland, have the opportunity to practice clinical skills with simulated patients during formative sessions in preparation for clerkships. These sessions are given in two formats: 1) direct observation of an encounter followed by verbal feedback (direct feedback) and 2) subsequent review of the videotaped encounter by both student and supervisor (video-based feedback). The aim of the study was to evaluate whether content and process of feedback differed between both formats.
Methods: In 2013, all second- and third-year medical students and clinical supervisors involved in formative sessions were asked to take part in the study. A sample of audiotaped feedback sessions involving supervisors who gave feedback in both formats were analyzed (content and process of the feedback) using a 21-item feedback scale.
Results: Forty-eight audiotaped feedback sessions involving 12 supervisors were analyzed (2 direct and 2 video-based sessions per supervisor). When adjusted for the length of feedback, there were significant differences in terms of content and process between both formats; the number of communication skills and clinical reasoning items addressed were higher in the video-based format (11.29 vs. 7.71, p=0.002 and 3.71 vs. 2.04, p=0.010, respectively). Supervisors engaged students more actively during the video-based sessions than during direct feedback sessions (self-assessment: 4.00 vs. 3.17, p=0.007; active problem-solving: 3.92 vs. 3.42, p=0.009). Students made similar observations and tended to consider that the video feedback was more useful for improving some clinical skills.
Conclusion: Video-based feedback facilitates discussion of clinical reasoning, communication, and professionalism issues while at the same time actively engaging students. Different time and conceptual frameworks may explain observed differences. The choice of feedback format should depend on the educational goal.
Keywords: OSCEs; direct observation; feedback; formative; quality; video review.
Conflict of interest statement
and funding The authors declare that they have no competing interests. The Edmond J. Safra Philanthropic Foundation supported the cost of the data collection.
Similar articles
-
The quality of feedback during formative OSCEs depends on the tutors' profile.BMC Med Educ. 2016 Nov 15;16(1):293. doi: 10.1186/s12909-016-0815-x. BMC Med Educ. 2016. PMID: 27846882 Free PMC article.
-
Medical students review of formative OSCE scores, checklists, and videos improves with student-faculty debriefing meetings.Med Educ Online. 2017;22(1):1324718. doi: 10.1080/10872981.2017.1324718. Med Educ Online. 2017. PMID: 28521646 Free PMC article.
-
Video-based on-ward supervision for final year medical students.BMC Med Educ. 2015 Sep 29;15:163. doi: 10.1186/s12909-015-0430-2. BMC Med Educ. 2015. PMID: 26419731 Free PMC article.
-
Changing an existing OSCE to a teaching tool: the making of a teaching OSCE.Acad Med. 2002 Sep;77(9):932. doi: 10.1097/00001888-200209000-00036. Acad Med. 2002. PMID: 12228103 Review.
-
Should essays and other "open-ended"-type questions retain a place in written summative assessment in clinical medicine?BMC Med Educ. 2014 Nov 28;14:249. doi: 10.1186/s12909-014-0249-2. BMC Med Educ. 2014. PMID: 25431359 Free PMC article. Review.
Cited by
-
Dual Coaching of Medical Clerkship Students' History Taking Skills by Volunteer Inpatients at the Bedside and Faculty Physicians on Zoom During the COVID-19 Pandemic.Adv Med Educ Pract. 2024 Oct 4;15:923-933. doi: 10.2147/AMEP.S472324. eCollection 2024. Adv Med Educ Pract. 2024. PMID: 39381803 Free PMC article.
-
"Well I Failed, but I Have No Idea Why"…: Experiences of Feedback After High-Stakes Summative Specialist Medical Examination in Ophthalmology.J Med Educ Curric Dev. 2024 Nov 3;11:23821205241286288. doi: 10.1177/23821205241286288. eCollection 2024 Jan-Dec. J Med Educ Curric Dev. 2024. PMID: 39497906 Free PMC article.
-
Expert-led and artificial intelligence (AI) system-assisted tutoring course increase confidence of Chinese medical interns on suturing and ligature skills: prospective pilot study.J Educ Eval Health Prof. 2019;16:7. doi: 10.3352/jeehp.2019.16.7. Epub 2019 Apr 10. J Educ Eval Health Prof. 2019. PMID: 30986892 Free PMC article.
-
Promoting student confidence in the OSCE process.Med Educ Online. 2017;22(1):1324719. doi: 10.1080/10872981.2017.1324719. Med Educ Online. 2017. PMID: 28521660 Free PMC article. No abstract available.
-
Coaching Residents in the Ambulatory Setting: Faculty Direct Observation and Resident Reflection.J Grad Med Educ. 2018 Aug;10(4):449-454. doi: 10.4300/JGME-17-00788.1. J Grad Med Educ. 2018. PMID: 30154978 Free PMC article.
References
-
- Hasnain M, Connell KJ, Downing SM, Olthoff A, Yudkowsky R. Toward meaningful evaluation of clinical competence: the role of direct observation in clerkship ratings. Acad Med. 2004;79:S21–4. - PubMed
-
- Sandars J. The e-learning site. Educ Prim Care. 2011;22:443–4. - PubMed
-
- Eva KW, Regehr G. Self-assessment in the health professions: a reformulation and research agenda. Acad Med. 2005;80:S46–54. - PubMed
-
- Ward M, Gruppen L, Regehr G. Measuring self-assessment: current state of the art. Adv Health Sci Educ Theory Pract. 2002;7:63–80. - PubMed
-
- Hattie J, Timperley H. The power of feedback. Rev Educ Res. 2007;77:81–112.
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources