Skills acquisition and assessment after a microsurgical skills course for ophthalmology residents

Abstract

Objective: To assess the impact of a skills course on microsurgical skills acquisition and to investigate the validity of a video-based modified Objective Structured Assessment of Technical Skill (OSATS) assessment tool that has not previously been applied to ophthalmic surgery.

Design: Prospective longitudinal cohort study.

Participants: Fourteen residents were recruited from 20 attendees at the Moorfields Eye Hospital microsurgical skills course for residents.

Methods: Each resident performed a standardized microsurgical task consisting of the placement of a 10-0 nylon corneal suture into a model eye using an operating microscope with standardized equipment in a standardized environment. Objective measurements were made using the Imperial College Surgical Assessment Device (ICSAD). This is a motion-tracking device returning 3 parameters for economy of movement: total path length, time, and number of individual hand movements. A concurrent video recording was made of each task by 2 independent observers who were masked to the time of the recording relative to the course and the identity of the resident. Video footage was marked in accordance with the OSATS video scoring template.

Main outcome measures: Each resident had motion-tracking analysis performed during corneal suturing before and after the course (total path length, time, and number of individual hand movements), along with concurrent OSATS video scores.

Results: Skills improvement after the course was found to be statistically significant for all 3 ICSAD economy of movement parameters: path length, P = 0.001; hand movements, P = 0.012; and time, P = 0.009. Differences in the combined OSATS scores of the 2 raters before and after the course were found to be significant (P = 0.039). Interrater reliability of OSATS scorers was 0.78 (alpha Cronbach). Correlations between the OSATS scores and each of the ICSAD parameters were found to be significant (P<0.001).

Conclusions: A video-based OSATS scoring system has significant correlation with the ICSAD motion-tracking parameters, demonstrating concurrent validity between the 2 assessment tools. These data also demonstrate that surgical skill, as measured by a validated motion-tracking system, is significantly improved after a 1-day microsurgical skills course.

Financial disclosure(s): The author(s) have no proprietary or commercial interest in any materials discussed in this article.