Interobserver agreement for contrast-enhanced ultrasound of liver imaging reporting and data system: A systematic review and meta-analysis
- PMID: 33344549
- PMCID: PMC7716336
- DOI: 10.12998/wjcc.v8.i22.5589
Interobserver agreement for contrast-enhanced ultrasound of liver imaging reporting and data system: A systematic review and meta-analysis
Abstract
Background: Hepatocellular carcinoma is the most common primary liver malignancy. From the results of previous studies, Liver Imaging Reporting and Data System (LI-RADS) on contrast-enhanced ultrasound (CEUS) has shown satisfactory diagnostic value. However, a unified conclusion on the interobserver stability of this innovative ultrasound imaging has not been determined. The present meta-analysis examined the interobserver agreement of CEUS LI-RADS to provide some reference for subsequent related research.
Aim: To evaluate the interobserver agreement of LI-RADS on CEUS and analyze the sources of heterogeneity between studies.
Methods: Relevant papers on the subject of interobserver agreement on CEUS LI-RADS published before March 1, 2020 in China and other countries were analyzed. The studies were filtered, and the diagnostic criteria were evaluated. The selected references were analyzed using the "meta" and "metafor" packages of R software version 3.6.2.
Results: Eight studies were ultimately included in the present analysis. Meta-analysis results revealed that the summary Kappa value of included studies was 0.76 [95% confidence interval, 0.67-0.83], which shows substantial agreement. Higgins I 2 statistics also confirmed the substantial heterogeneity (I 2 = 91.30%, 95% confidence interval, 85.3%-94.9%, P < 0.01). Meta-regression identified the variables, including the method of patient enrollment, method of consistency testing, and patient race, which explained the substantial study heterogeneity.
Conclusion: CEUS LI-RADS demonstrated overall substantial interobserver agreement, but heterogeneous results between studies were also obvious. Further clinical investigations should consider a modified recommendation about the experimental design.
Keywords: Contrast-enhanced ultrasound; Diagnosis; Interobserver agreement; Liver imaging reporting and data system; Meta-analysis; Systematic review.
©The Author(s) 2020. Published by Baishideng Publishing Group Inc. All rights reserved.
Conflict of interest statement
Conflict-of-interest statement: There is no conflict of interest associated with any of the senior author or other co-authors who contributed their efforts in this manuscript.
Figures




Similar articles
-
Interobserver and intermodality agreement of standardized algorithms for non-invasive diagnosis of hepatocellular carcinoma in high-risk patients: CEUS-LI-RADS versus MRI-LI-RADS.Eur Radiol. 2018 Oct;28(10):4254-4264. doi: 10.1007/s00330-018-5379-1. Epub 2018 Apr 19. Eur Radiol. 2018. PMID: 29675659
-
Usefulness of the Contrast-Enhanced Ultrasound Liver Imaging Reporting and Data System in Diagnosing Focal Liver Lesions by Inexperienced Radiologists.J Ultrasound Med. 2020 Aug;39(8):1537-1546. doi: 10.1002/jum.15242. Epub 2020 Feb 20. J Ultrasound Med. 2020. PMID: 32078173
-
The interreader agreement and validation of contrast-enhanced ultrasound liver imaging reporting and data system.Eur J Radiol. 2019 Nov;120:108685. doi: 10.1016/j.ejrad.2019.108685. Epub 2019 Oct 7. Eur J Radiol. 2019. PMID: 31606712
-
Clinical Application of Liver Imaging Reporting and Data System for Characterizing Liver Neoplasms: A Meta-Analysis.Diagnostics (Basel). 2021 Feb 17;11(2):323. doi: 10.3390/diagnostics11020323. Diagnostics (Basel). 2021. PMID: 33671158 Free PMC article. Review.
-
Contrast-enhanced ultrasound (CEUS) liver imaging reporting and data system (LI-RADS) 2017 - a review of important differences compared to the CT/MRI system.Clin Mol Hepatol. 2017 Dec;23(4):280-289. doi: 10.3350/cmh.2017.0037. Epub 2017 Sep 15. Clin Mol Hepatol. 2017. PMID: 28911220 Free PMC article. Review.
Cited by
-
Endoleak Detection after Endovascular Aortic Repair via Coded-Excitation Ultrasound-A Feasibility Study.J Clin Med. 2023 May 31;12(11):3775. doi: 10.3390/jcm12113775. J Clin Med. 2023. PMID: 37297970 Free PMC article.
-
Diagnostic performance of contrast-enhanced US in small liver nodules not conclusively characterized after MRI in cirrhotic patients.Eur Radiol. 2025 Sep;35(9):5771-5780. doi: 10.1007/s00330-025-11495-3. Epub 2025 Mar 7. Eur Radiol. 2025. PMID: 40055232
-
Inter-reader reliability of contrast-enhanced ultrasound Liver Imaging Reporting and Data System: a meta-analysis.Abdom Radiol (NY). 2021 Oct;46(10):4671-4681. doi: 10.1007/s00261-021-03169-7. Epub 2021 Jun 22. Abdom Radiol (NY). 2021. PMID: 34156509
-
Diagnosis of Non-Hepatocellular Carcinoma Malignancies in Patients With Risks for Hepatocellular Carcinoma: CEUS LI-RADS Versus CT/MRI LI-RADS.Front Oncol. 2021 Apr 12;11:641195. doi: 10.3389/fonc.2021.641195. eCollection 2021. Front Oncol. 2021. PMID: 33912456 Free PMC article.
-
Inter-Reader Agreement for Contrast-Enhanced Ultrasound Liver Imaging Reporting and Data System Major Features and Final Categorization: A Subanalysis From a Prospective Multicenter Study.J Ultrasound Med. 2025 Feb;44(2):349-357. doi: 10.1002/jum.16608. Epub 2024 Oct 29. J Ultrasound Med. 2025. PMID: 39470295 Free PMC article.
References
-
- El-Serag HB. Hepatocellular carcinoma. N Engl J Med. 2011;365:1118–1127. - PubMed
-
- Wang JY, Feng SY, Yi AJ, Zhu D, Xu JW, Li J, Cui XW, Dietrich CF. Comparison of Contrast-Enhanced Ultrasound vs Contrast-Enhanced Magnetic Resonance Imaging for the Diagnosis of Focal Liver Lesions Using the Liver Imaging Reporting and Data System. Ultrasound Med Biol. 2020;46:1216–1223. - PubMed
-
- Lu DS, Yu NC, Raman SS, Limanond P, Lassman C, Murray K, Tong MJ, Amado RG, Busuttil RW. Radiofrequency ablation of hepatocellular carcinoma: treatment success as defined by histologic examination of the explanted liver. Radiology. 2005;234:954–960. - PubMed
LinkOut - more resources
Full Text Sources