Inter-observer reproducibility of the 2021 AAGL Endometriosis Classification
- PMID: 38896105
- PMCID: PMC11924167
- DOI: 10.1111/ajo.13851
Inter-observer reproducibility of the 2021 AAGL Endometriosis Classification
Abstract
Background: Inter-observer agreement for the American Association of Gynecologic Laparoscopists (AAGL) 2021 Endometriosis Classification staging system has not been described. Its predecessor staging system, the revised American Society for Reproductive Medicine (rASRM), has historically demonstrated poor inter-observer agreement.
Aims: We aimed to determine the inter-observer agreement performance of the AAGL 2021 Endometriosis Classification staging system, and compare this with the rASRM staging system.
Materials and methods: A database of 317 patients with coded surgical data was retrospectively analysed. Three independent observers allocated AAGL surgical stages (1-4), twice. Observers made their own interpretation of how to apply the tool in the first staging allocation. Consensus rules were then developed for a second staging allocation.
Results: First staging allocation: odds ratio (OR) (and 95% CI) for observer 1 to score higher than observer 2 was 8.08 (5.12-12.76). Observer 1 to score higher than observer 3 was 12.98 (7.99-21.11) and observer 2 to score higher than observer 3 was 1.61 (1.03-2.51). This represents poor agreement. Second staging allocation (after consensus): OR for observer 1 to score higher than observer 2 was 1.14 (0.64-2.03), observer 1 to score higher than observer 3 was 1.81 (0.99-3.28) and observer 2 to score higher than observer 3 was 1.59 (0.87-2.89). This represents good agreement.
Conclusions: These findings suggest that in its current format the AAGL 2021 Endometriosis Classification staging system has poor inter-observer agreement, not superior to the rASRM staging system. However, performance improved when additional measures were taken to simplify and clarify areas of ambiguity in interpreting the staging system.
Keywords: endometriosis; laparoscopic surgery; observer variation.
© 2024 The Author(s). Australian and New Zealand Journal of Obstetrics and Gynaecology published by John Wiley & Sons Australia, Ltd on behalf of Royal Australian and New Zealand College of Obstetricians and Gynaecologists.
Figures
Similar articles
-
External Validation of the "2021 AAGL Endometriosis Classification": A Retrospective Cohort Study.J Minim Invasive Gynecol. 2023 May;30(5):374-381. doi: 10.1016/j.jmig.2022.12.012. Epub 2023 Jan 5. J Minim Invasive Gynecol. 2023. PMID: 36621635
-
AAGL 2021 Endometriosis Classification: An Anatomy-based Surgical Complexity Score.J Minim Invasive Gynecol. 2021 Nov;28(11):1941-1950.e1. doi: 10.1016/j.jmig.2021.09.709. Epub 2021 Sep 25. J Minim Invasive Gynecol. 2021. PMID: 34583009
-
Prospective external validation and exploration of the "2021 AAGL endometriosis classification".Eur J Obstet Gynecol Reprod Biol. 2025 Apr 17;308:90-95. doi: 10.1016/j.ejogrb.2025.02.048. Epub 2025 Feb 24. Eur J Obstet Gynecol Reprod Biol. 2025. PMID: 40020456
-
Endometriosis Fertility Index: is it better than the present staging systems?Curr Opin Obstet Gynecol. 2013 Jun;25(3):186-92. doi: 10.1097/GCO.0b013e32836091da. Curr Opin Obstet Gynecol. 2013. PMID: 23571831 Review.
-
Are we better off using multiple endometriosis classifications in imaging and surgery than settle for one universal less than perfect protocol? Review of staging systems in ultrasound, magnetic resonance and surgery.J Obstet Gynaecol. 2022 Jan;42(1):10-16. doi: 10.1080/01443615.2021.1887111. Epub 2021 May 19. J Obstet Gynaecol. 2022. PMID: 34009105 Review.
References
-
- Andres MP, Borrelli GM, Abrão MS. Endometriosis classification according to pain symptoms: can the ASRM classification be improved? Best Pract Res Clin Obstet Gynaecol 2018; 51: 111–118. - PubMed
-
- Haas D, Shebl O, Shamiyeh A, Oppelt P. The rASRM score and the Enzian classification for endometriosis: their strengths and weaknesses. Acta Obstet Gynecol Scand 2013; 92(1): 3–7. - PubMed
-
- Buchweitz O, Wülfing P, Malik E. Interobserver variability in the diagnosis of minimal and mild endometriosis. Eur J Obstet Gynecol Reprod Biol 2005; 122(2): 213–217. - PubMed
-
- Abrao MS, Andres MP, Miller CE et al. AAGL 2021 endometriosis classification: an anatomy‐based surgical complexity score. J Minim Invasive Gynecol 2021; 28(11): 1941–1950.e1. - PubMed
-
- Mak J, Eathorne A, Leonardi M et al. External validation of the “2021 AAGL Endometriosis Classification”: a retrospective cohort study. J Minim Invasive Gynecol 2023; 30: 374–381. - PubMed
MeSH terms
LinkOut - more resources
Full Text Sources
Medical