Feasibility and acceptability of virtual mock oral examinations for senior vascular surgery trainees and implications for the certifying exam

Abstract

Objectives: The COVID-19 pandemic resulted in the cancellation of in-person testing across the country. We sought to understand the feasibility of conducting virtual oral examinations as well as solicit opinions of vascular surgery program directors (PD) regarding the use of virtual platforms to conduct both low stakes mock oral examinations with their trainees and potentially "real" high stakes certifying examinations (CE) moving forward.

Methods: Forty-four senior vascular surgery trainees from 17 institutions took part in a virtual mock oral examination conducted by 38 practicing vascular surgeons via Zoom. Each examination lasted 30 minutes with four clinical scenarios. An anonymous survey pertaining to the conduct of the examination and opinions on feasibility of using virtual examinations for the vascular surgery CE was sent to all examiners and examinees. A similar survey was sent to all vascular surgery program directors.

Results: The overall pass rate was 82% (36/44 participants) with no correlation with training paradigm. 32/44 (73%) of trainees, 29/38 (76%) of examiners and 49/103 (48%) of PDs completed the surveys. Examinees and examiners thought the experience was beneficial and PDs also thought the experience would be beneficial for their trainees. While the majority of trainees and examiners believed they were able to communicate and express (or evaluate) knowledge and confidence as easily virtually as in person, PDs were less likely to agree confidence could be assessed virtually. The majority of respondents thought the CE of the Vascular Surgery Board of the American Board of Surgery could be offered virtually, although no groups thought virtual exams were superior to in person exams. While cost benefit was perceived in virtual examinations, the security of the examination was a concern.

Conclusions: Performing virtual mock oral examinations for vascular surgery trainees is feasible. Both vascular surgery trainees as well as PDs feel that virtual CEs should be considered by the Vascular Surgery Board.

Keywords: Education; Mock Orals; Remote; Vascular Surgery; Virtual.

Fig. 1

Standardized scoring sheet.

Fig. 2

Radar plot of ranked attributes.

Fig. 3

Which of the following would be beneficial and improve the virtual mock oral experience for trainees?.

Fig. 4

Difficulties encountered during the mock oral examinations for examinees and examiners.

Fig. 5

Which trainees should participate in virtual mock oral examinations?.