Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Clinical Trial
. 2004 May 18:4:9.
doi: 10.1186/1471-230X-4-9.

Inter-observer agreement in the assessment of endoscopic findings in ulcerative colitis

Thomas de Lange  1 , Stig Larsen, Lars Aabakken
Affiliations
Clinical Trial

Inter-observer agreement in the assessment of endoscopic findings in ulcerative colitis

Thomas de Lange et al. BMC Gastroenterol. .

Abstract

Background: Endoscopic findings are essential in evaluating the disease activity in ulcerative colitis. The aim of this study was to evaluate how endoscopists assess individual endoscopic features of mucosal inflammation in ulcerative colitis, the inter-observer agreement, and the importance of the observers' experience.

Methods: Five video clips of ulcerative colitis were shown to a group of experienced and a group of inexperienced endoscopists. Both groups were asked to assess eight endoscopic features and the overall mucosal inflammation on a visual analogue scale. The following statistical analyses were used; Contingency tables analysis, kappa analysis, analysis of variance, Pearson linear correlation analysis, general linear models, and agreement analysis. All tests were carried out two-tailed, with a significance level of 5%.

Results: The inter-observer agreement ranged from very good to moderate in the experienced group and from very good to fair in the inexperienced group. There was a significantly better inter-observer agreement in the experienced group in the rating of 6 out of 9 features (p < 0.05). The experienced and inexperienced endoscopists scored the "ulcerations" significantly different. (p = 0.05). The inter-observer variation of the mean score of "erosions", "ulcerations" and endoscopic activity index in mild disease, and the scoring of "erythema" and "oedema" in moderate-severe disease was significantly higher in the inexperienced group.A correlation was seen between all the observed endoscopic features in both groups of endoscopists. Among experienced endoscopists, a set of four endoscopic variables ("Vascular pattern", "Erosions", "Ulcerations" and Friability") explained 92% of the variation in EAI. By including "Granularity" in these set 91% of the variation in EAI was explained in the group of inexperienced endoscopists.

Conclusion: The inter-observer agreement in the rating of endoscopic features characterising ulcerative colitis is satisfactory in both groups of endoscopists but significantly higher in the experienced group. The difference in the mean score between the two groups is only significant for "ulcerations". The endoscopic variables "Vascular pattern", "Erosions", "Ulcerations" and Friability" explained the overall endoscopic activity index. Even though the present result is quite satisfactory, there is a potential of improvement. Improved grading systems might contribute to improve the consistency of endoscopic descriptions.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Visual analogue scales for the assessment of endoscopic features
Figure 2
Figure 2
Regression analysis and agreement plots for experienced and inexperienced endoscopists The linear relation between "Observed EAI" and "Gold standard" in the group of inexperienced (2a) and experienced (2b) endoscopists. The results expressed by the linear regression line with 95% confidence interval for the lines. The agreement plot in the group of inexperienced (2c) and experienced (2d) endoscopists. The results expressed by the line of mean with 95% confidence interval for the lines.
Figure 3
Figure 3
Endoscopic images of ulcerative colitis
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. The role of colonoscopy in the management of patients with inflammatory bowel disease. American Society for Gastrointestinal Endoscopy. Gastrointest Endosc. 1998;48:689–690. - PubMed
    1. Marteau P. Inflammatory bowel disease. Endoscopy. 2002;34:63–68. doi: 10.1055/s-2002-19392. - DOI - PubMed
    1. De Lange T, Moum BA, Tholfsen JK, Larsen S, Aabakken L. Standardization and quality of endoscopy text reports in ulcerative colitis. Endoscopy. 2003;35:835–840. doi: 10.1055/s-2003-42619. - DOI - PubMed
    1. Baron JH, Connell AM, Lennard-Jones JE. Variation Between Observers in Describing Mucosal Appearances in Proctocolitis. Br Med J. 1964;1:89–92. - PMC - PubMed
    1. Gomes P, du BC, Smith CL, Holdstock G. Relationship between disease activity indices and colonoscopic findings in patients with colonic inflammatory bowel disease. Gut. 1986;27:92–95. - PMC - PubMed