Validation of a new basic virtual reality simulator for training of basic endoscopic skills: the SIMENDO

Abstract

Background: The aim of this study was to establish content, face, concurrent, and the first step of construct validity of a new simulator, the SIMENDO, in order to determine its usefulness for training basic endoscopic skills.

Methods: The validation started with an explanation of the goals, content, and features of the simulator (content validity). Then, participants from eight different medical centers consisting of experts (> or =100 laparoscopic procedures performed) and surgical trainees (<100) were informed of the goals and received a "hands-on tour" of the virtual reality (VR) trainer. Subsequently, they were asked to answer 28 structured questions about the simulator (face validity). Ratings were scored on a scale from 1 (very bad/useless) to 5 (excellent/very useful). Additional comments could be given as well. Furthermore, two experiments were conducted. In experiment 1, aimed at establishing concurrent validity, the training effect of a single-handed hand-eye coordination task in the simulator was compared with a similar task in a conventional box trainer and with the performance of a control group that received no training. In experiment 2 (first step of construct validity), the total score of task time, collisions, and path length of three consecutive runs in the simulator was compared between experts (>100 endoscopic procedures) and novices (no experience).

Results: A total of 75 participants (36 expert surgeons and 39 surgical trainees) filled out the questionnaire. Usefulness of tasks, features, and movement realism were scored between a mean value of 3.3 for depth perception and 4.3 for appreciation of training with the instrument. There were no significant differences between the mean values of the scores given by the experts and surgical trainees. In response to statements, 81% considered this VR trainer generally useful for training endoscopic techniques to residents, and 83% agreed that the simulator was useful to train hand-eye coordination. In experiment 1, the training effect for the single-handed task showed no significant difference between the conventional trainer and the VR simulator (concurrent validity). In experiment 2, experts scored significantly better than novices on all parameters used (construct validity).

Conclusion: Content, face, and concurrent validity of the SIMENDO is established. The simulator is considered useful for training eye-hand coordination for endoscopic surgery. The evaluated task could discriminate between the skills of experienced surgeons and novices, giving the first indication of construct validity.