Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Jan 13;18(1):16.
doi: 10.1007/s11701-023-01756-y.

Measures of performance and proficiency in robotic assisted surgery: a systematic review

Charlotte El-Sayed  1 , A Yiu  2 , J Burke  2 , P Vaughan-Shaw  2 , J Todd  2 , P Lin  2 , Z Kasmani  2 , C Munsch  2 , L Rooshenas  2 , M Campbell  2 , S P Bach  2
Affiliations

Measures of performance and proficiency in robotic assisted surgery: a systematic review

Charlotte El-Sayed et al. J Robot Surg. .

Erratum in

Abstract

Robotic assisted surgery (RAS) has seen a global rise in adoption. Despite this, there is not a standardised training curricula nor a standardised measure of performance. We performed a systematic review across the surgical specialties in RAS and evaluated tools used to assess surgeons' technical performance. Using the PRISMA 2020 guidelines, Pubmed, Embase and the Cochrane Library were searched systematically for full texts published on or after January 2020-January 2022. Observational studies and RCTs were included; review articles and systematic reviews were excluded. The papers' quality and bias score were assessed using the Newcastle Ottawa Score for the observational studies and Cochrane Risk Tool for the RCTs. The initial search yielded 1189 papers of which 72 fit the eligibility criteria. 27 unique performance metrics were identified. Global assessments were the most common tool of assessment (n = 13); the most used was GEARS (Global Evaluative Assessment of Robotic Skills). 11 metrics (42%) were objective tools of performance. Automated performance metrics (APMs) were the most widely used objective metrics whilst the remaining (n = 15, 58%) were subjective. The results demonstrate variation in tools used to assess technical performance in RAS. A large proportion of the metrics are subjective measures which increases the risk of bias amongst users. A standardised objective metric which measures all domains of technical performance from global to cognitive is required. The metric should be applicable to all RAS procedures and easily implementable. Automated performance metrics (APMs) have demonstrated promise in their wide use of accurate measures.

Keywords: Assessment; Curriculum; Metric; Performance; Robotic surgery; Training.

PubMed Disclaimer

References

    1. Birkmeyer JD, Finks JF, O’Reilly A, Oerline M, Carlin AM, Nunn AR et al (2013) Surgical skill and complication rates after bariatric surgery. N Engl J Med 369(15):1434–1442 - PubMed - DOI
    1. Curtis NJ, Foster JD, Miskovic D, Brown CSB, Hewett PJ, Abbott S et al (2020) Association of surgical skill assessment with clinical outcomes in cancer surgery. JAMA Surg 155(7):590–598
    1. Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat A-HS, Dellinger EP et al (2009) A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med 360(5):491–499 - PubMed - DOI
    1. Jung JJ, Juni P, Lebovic G, Grantcharov T (2020) First-year analysis of the operating room black box study. Ann Surg 271(1):122–127 - PubMed - DOI
    1. Garbens A, Goldenberg M, Wallis CJD, Tricco A, Grantcharov TP (2018) The cost of intraoperative adverse events in abdominal and pelvic surgery: a systematic review. Am J Surg 215(1):163–170 - PubMed - DOI

LinkOut - more resources