Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2007 Jun;245(6):992-9.
doi: 10.1097/01.sla.0000262780.17950.e5.

An evaluation of the feasibility, validity, and reliability of laparoscopic skills assessment in the operating room

Affiliations

An evaluation of the feasibility, validity, and reliability of laparoscopic skills assessment in the operating room

Rajesh Aggarwal et al. Ann Surg. 2007 Jun.

Abstract

Objective: To assess the use of a synchronized video-based motion tracking device for objective, instant, and automated assessment of laparoscopic skill in the operating room.

Summary background data: The assessment of technical skills is fundamental to recognition of proficient surgical practice. It is necessary to demonstrate the validity, reliability, and feasibility of any tool to be applied for objective measurement of performance.

Methods: Nineteen subjects, divided into 13 experienced (performed >100 laparoscopic cholecystectomies) and 6 inexperienced (performed <10 LCs) surgeons completed LCs on 53 patients who all had a diagnosis of biliary colic. Each procedure was recorded with the ROVIMAS video-based motion tracking device to provide an objective measure of the surgeon's dexterity. Each video was also rated by 2 experienced observers on a previously validated operative assessment scale.

Results: There were significant differences for motion tracking parameters between the 2 groups of surgeons for the Calot triangle dissection part of procedure for time taken (P = 0.002), total path length (P = 0.026), and number of movements (P = 0.005). Both motion tracking and video-based assessment displayed intertest reliability, and there were good correlations between the 2 modes of assessment (r = 0.4 to 0.7, P < 0.01).

Conclusions: An instant, objective, valid, and reliable mode of assessment of laparoscopic performance in the operating room has been defined. This may serve to reduce the time taken for technical skills assessment, and subsequently lead to accurate and efficient audit and credentialing of surgeons for independent practice.

PubMed Disclaimer

Figures

None
FIGURE 1. Time taken for experienced and novice surgeons to dissect Calot triangle. There was a significant difference between experienced and inexperienced groups (P = 0.002).
None
FIGURE 2. Total path length for experienced and novice surgeons to dissect Calot triangle. There was a significant difference between experienced and inexperienced groups (P = 0.048).
None
FIGURE 3. Total number of movements for experienced and novice surgeons to dissect Calot triangle. There was a significant difference between experienced and inexperienced groups (P = 0.007).
None
FIGURE 4. Inter-rater reliability of OSATS global rating score between observer 1 and 2 (Cronbach's α = 0.72).

References

    1. Cuschieri A. Medical error, incidents, accidents and violations. Min Inv Ther Allied Technol. 2003;12:111–120. - PubMed
    1. Reason J. Human Error. Cambridge: Cambridge University Press; 1994.
    1. Smith R. All changed, changed utterly: British medicine will be transformed by the Bristol case. BMJ. 1998;316:1917–1918. - PMC - PubMed
    1. Elwyn G, Corrigan JM. The patient safety story. BMJ. 2005;331:302–304. - PMC - PubMed
    1. Dent TL. Training, credentialling, and granting of clinical privileges for laparoscopic general surgery. Am J Surg. 1991;161:399–403. - PubMed

Publication types

LinkOut - more resources