A surgical skills assessment rubric for pterygium surgery

Abstract

Purpose: To introduce an assessment tool (rubric) for evaluating ophthalmology residents' competency in pterygium surgery.

Methods: A panel of experienced international surgeons collaborated and developed the rubric. After describing various stages of the procedure, the Dreyfus scale of skill acquisition was used for scoring each stage. After finalizing the rubric, two surgeons independently evaluated 20 masked pterygium surgery videos of 10 residents and scored the videos according to the rubric. The agreement between the scores of them was examined with the intra-class correlation coefficient test.

Results: This rubric divides pterygium surgery into 13 different stages and covers the two most common techniques of pterygium surgery; conjunctival autograft and amniotic membrane transplant. The rubric showed face and content validity. Overall, an intraclass correlation coefficient of 0.90 (95% confidence interval 0.76-0.96, P < 0.001) was achieved between the two surgeons. The residents scored significantly higher on surgeries performed later in their rotation compared to the earlier surgeries (4.32 ± 0.35 vs 3.96 ± 0.31, P = 0.006). Certain stages of pterygium surgery were more strongly correlated with the residents' past pterygium surgical experience.

Conclusion: This study introduces an international rubric for assessing competency in pterygium surgery. In addition to face and content validity, this rubric shows high inter-rater reliability. This may be a useful tool for teaching and measuring competency in pterygium surgery.

Keywords: Pterygium surgery; Rubric; Surgical skill assessment.