Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Oct 23:17:17562848241290256.
doi: 10.1177/17562848241290256. eCollection 2024.

Bowel cleansing quality evaluation in colon capsule endoscopy: what is the reference standard?

Affiliations

Bowel cleansing quality evaluation in colon capsule endoscopy: what is the reference standard?

Benedicte Schelde-Olesen et al. Therap Adv Gastroenterol. .

Abstract

Background: The diagnostic accuracy of colon capsule endoscopy (CCE) depends on a well-cleansed bowel. Evaluating the cleansing quality can be difficult with a substantial interobserver variation.

Objectives: Our primary aim was to establish a standard of agreement for bowel cleansing in CCE based on evaluations by expert readers. Then, we aimed to investigate the interobserver agreement on bowel cleansing.

Design: We conducted an interobserver agreement study on bowel cleansing quality.

Methods: Readers with different experience levels in CCE and colonoscopy evaluated bowel cleansing quality on the Leighton-Rex scale and Colon Capsule CLEansing Assessment and Report (CC-CLEAR), respectively. All evaluations were reported on an image level. A total of 24 readers rated 500 images on each scale.

Results: An expert opinion-based agreement standard could be set for poor and excellent cleansing but not for the spectrum in between, as the experts agreed on only a limited number of images representing fair and good cleansing. The overall interobserver agreement on the Leighton-Rex full scale was good (intraclass correlation coefficient (ICC) 0.84, 95% CI (0.82-0.85)) and remained good when stratified by experience level. On the full CC-CLEAR scale, the overall agreement was moderate (ICC 0.62, 95% CI (0.59-0.65)) and remained so when stratified by experience level.

Conclusion: The interobserver agreement was good for the Leighton-Rex scale and moderate for CC-CLEAR, irrespective of the reader's experience level. It was not possible to establish an expert-opinion standard of agreement for cleansing quality in CCE images. Dedicated training in using the scales may improve agreement and enable future algorithm calibration for artificial intelligence supported cleansing evaluation.

Trial registration: All included images were derived from the CAREforCOLON 2015 trial (Registered with The Regional Health Research Ethics Committee (Registration number: S-20190100), the Danish data protection agency (Ref. 19/29858), and ClinicalTrials.gov (registration number: NCT04049357)).

Keywords: artificial intelligence algorithm; bowel cleansing; colon capsule endoscopy; interobserver agreement.

PubMed Disclaimer

Conflict of interest statement

Benedicte Schelde-Olesen has received honoraria and participated in advisory board meetings for Jinshan Ltd. Anastasios Koulaouzidis is shareholder of iCERV Ltd., has received consultancy fees and travel support from Jinshan Ltd., and has participated in advisory board meetings hosted by Dr FalkPharmaUK, Norgine, Jinshan, and ANKON. Emanuele Rondonotti has received honoraria from Fujifilm and consultancy fees from Medtronic. Xavier Dray has received lecture fees from Alfasigma, Bouchara, Recordati, Fujifilm, Medtronic, Norgine and Sandoz, has received consultancy fees from Norgine and Provepharma and is co-founder and shareholder of Augmented Endoscopy. Stefania Piccirelli has received a travel grant from AnX Robotica and honoraria from Malesci. Ulrik Deding, Ervin Toth, Konstantinos John Dabos, Abraham Eliakim, Cristina Carretero, Begoña González-Suárez, Thomas de Lange, Hanneke Beaumont, Uri Kopylov, Pierre Ellul, Enrique Pérez-Cuadrado-Robles, Alexander Robertson, Irene Stenfors, Alejandro Bojorquez, Gitte Grunnet Raabe, Reuma Margalit-Yehuda, Isabel Barba, Giulia Scardino, Salome Ouazana, Thomas Bjørsum-Meyer declare no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Figures

Figure 1.
Figure 1.
Instructions for capsule readers on CC-CLEAR visible within the survey. CC-CLEAR, Colon Capsule CLEansing Assessment and Report.
Figure 2.
Figure 2.
Project setup and flow.
Figure 3.
Figure 3.
Examples of images with good agreement between readers on the Leighton–Rex scale. (a) Poor (24 readers in agreement). (b) Fair (21 readers in agreement). (c) Good (22 readers in agreement). (d) Excellent (24 readers in agreement).

Similar articles

Cited by

References

    1. Leighton JA, Rex DK. A grading scale to evaluate colon cleansing for the PillCam COLON capsule: a reliability study. Endoscopy 2011; 43: 123–127. - PubMed
    1. de Sousa Magalhães R, Arieira C, Boal Carvalho P, et al.. Colon Capsule CLEansing Assessment and Report (CC-CLEAR): a new approach for evaluation of the quality of bowel preparation in capsule colonoscopy. Gastrointest Endosc 2021; 93: 212–223. - PubMed
    1. Buijs MM, Kroijer R, Kobaek-Larsen M, et al.. Intra and inter-observer agreement on polyp detection in colon capsule endoscopy evaluations. United European Gastroenterol J 2018; 6: 1563–1568. - PMC - PubMed
    1. Buijs MM, Ramezani MH, Herp J, et al.. Assessment of bowel cleansing quality in colon capsule endoscopy using machine learning: a pilot study. Endosc Int Open 2018; 6: E1044–E1050. - PMC - PubMed
    1. Becq A, Histace A, Camus M, et al.. Development of a computed cleansing score to assess quality of bowel preparation in colon capsule endoscopy. Endosc Int Open 2018; 6: E844–E850. - PMC - PubMed

Associated data

LinkOut - more resources