Construct validity of the LapSim: can the LapSim virtual reality simulator distinguish between novices and experts?

Abstract

Background: Virtual reality simulators may be invaluable in training and assessing future endoscopic surgeons. The purpose of this study was to investigate if the results of a training session reflect the actual skill of the trainee who is being assessed and thereby establish construct validity for the LapSim virtual reality simulator (Surgical Science Ltd., Gothenburg, Sweden).

Methods: Forty-eight subjects were assigned to one of three groups: 16 novices (0 endoscopic procedures), 16 surgical residents in training (>10 but <100 endoscopic procedures), and 16 experienced endoscopic surgeons (>100 endoscopic procedures). Performance was measured by a relative scoring system that combines single parameters measured by the computer.

Results: The higher the level of endoscopic experience of a participant, the higher the score. Experienced surgeons and surgical residents in training showed statistically significant higher scores than novices for both overall score and efficiency, speed, and precision parameters.

Conclusions: Our results show that performance of the various tasks on the simulator corresponds to the respective level of endoscopic experience in our research population. This study demonstrates construct validity for the LapSim virtual reality simulator. It thus measures relevant skills and can be integrated in an endoscopic training and assessment program.