Construct Validity and Experience of Using a Low-cost Arthroscopic Knee Surgery Simulator

Abstract

Objective: To validate an affordable and easily reproducible arthroscopic knee surgery simulator made from simple, low-cost materials by demonstrating its ability to distinguish experienced from novice arthroscopists (i.e., construct validity). Additionally, acceptance and usefulness of the simulator in medical training and education were assessed.

Design: The simulator was used to perform a partial meniscectomy in both menisci. External and intra-articular images obtained during the procedures were used to assess objective visual parameters. The Arthroscopic Surgical Skill Evaluation Tool and a Likert scale addressing individual perceptions about the simulator and its applicability in medical education were also used.

Setting: The study was conducted at Hospital de Clínicas da Universidade Federal do Paraná, a teaching hospital in southern Brazil.

Participants: Thirty sixth-year medical students were recruited, as well as 10 orthopedic surgeons who had knee arthroscopy expertise and were members of a sports traumatology and knee arthroscopy group.

Results: There were statistically significant differences between the groups in all objective parameters. The mean time to perform the procedure was 60% higher among students compared to surgeons. Students needed 72.5% more time on average to perform triangulations and obtained an error rate approximately twice higher in the assessment of the area removed from the menisci. Regarding Arthroscopic Surgical Skill Evaluation Tool scores, statistically significant differences were found between surgeons and students in all 8 domains and in the total score. The simulator was well accepted, as over 90% of participants found it useful for education and training, believed it contributed to teaching and assessing specific surgical steps and procedures, and reported that the task was enjoyable.

Conclusions: The arthroscopic knee surgery simulator was largely accepted and had good applicability in objective measurement of surgical skills, distinguishing medical students from orthopedic surgeons and thus demonstrating construct validity.

Keywords: Medical Knowledge; Practice-Based Learning and Improvement; arthroscopy; knee joint; medical education; simulation training.