Lack of a discriminatory function for endoscopy skills on a computer-based simulator

Abstract

Background: Computer-based endoscopy simulators have been developed to enable trainees to learn and gain technical endoscopic skills before operating on patients. However, these simulators have not been validated as models of patient-based endoscopy. This study aimed to determine whether a computer-based simulator can accurately represent an actual esophagogastroduodenoscopy (EGD) and colonoscopy and to evaluate its ability to discriminate between varying levels of expertise in performing endoscopic procedures based on objective parameters.

Methods: In a prospective, observational trial, five first-year gastroenterology fellows and six gastroenterology attendings from a single academic center completed six endoscopy cases on the Simbionix GI Mentor II endoscopy simulator. The cases were selected to represent common clinical scenarios. The performance parameters were collected by the simulator. The 13 performance parameters measured by the endoscopy simulator were compared between the two study groups. After the simulator cases, the participants completed a survey evaluating the realism of the simulator.

Results: Novices and experts were able to complete the tasks in the simulated cases with no significant overall differences between the two groups. The computer-based simulator was able to discriminate levels of expertise only for parameters related to the time spent on the procedure (total time, time to reach the second duodenum, time to reach the cecum, and efficiency of screening). No statistically significant differences were found for the other nine performance parameters measured by the simulator. Based on the survey data, expert opinion concluded that the simulator does not offer a realistic simulation of human endoscopy.

Conclusions: The computer-based endoscopy simulator displays a lack of ability to discriminate between novices and experts in terms of endoscopic skills based on measured objective performance parameters. The findings of this study suggest that the computer-based simulator lacks fidelity and that upgrades are necessary to increase the simulator's ability to reproduce human endoscopy more accurately.