Quality control of B-lines analysis in stress Echo 2020
- PMID: 30249305
- PMCID: PMC6154410
- DOI: 10.1186/s12947-018-0138-7
Quality control of B-lines analysis in stress Echo 2020
Abstract
Background: The effectiveness trial "Stress echo (SE) 2020" evaluates novel applications of SE in and beyond coronary artery disease. The core protocol also includes 4-site simplified scan of B-lines by lung ultrasound, useful to assess pulmonary congestion.
Purpose: To provide web-based upstream quality control and harmonization of B-lines reading criteria.
Methods: 60 readers (all previously accredited for regional wall motion, 53 B-lines naive) from 52 centers of 16 countries of SE 2020 network read a set of 20 lung ultrasound video-clips selected by the Pisa lab serving as reference standard, after taking an obligatory web-based learning 2-h module ( http://se2020.altervista.org ). Each test clip was scored for B-lines from 0 (black lung, A-lines, no B-lines) to 10 (white lung, coalescing B-lines). The diagnostic gold standard was the concordant assessment of two experienced readers of the Pisa lab. The answer of the reader was considered correct if concordant with reference standard reading ±1 (for instance, reference standard reading of 5 B-lines; correct answer 4, 5, or 6). The a priori determined pass threshold was 18/20 (≥ 90%) with R value (intra-class correlation coefficient) between reference standard and recruiting center) > 0.90. Inter-observer agreement was assessed with intra-class correlation coefficient statistics.
Results: All 60 readers were successfully accredited: 26 (43%) on first, 24 (40%) on second, and 10 (17%) on third attempt. The average diagnostic accuracy of the 60 accredited readers was 95%, with R value of 0.95 compared to reference standard reading. The 53 B-lines naive scored similarly to the 7 B-lines expert on first attempt (90 versus 95%, p = NS). Compared to the step-1 of quality control for regional wall motion abnormalities, the mean reading time per attempt was shorter (17 ± 3 vs 29 ± 12 min, p < .01), the first attempt success rate was higher (43 vs 28%, p < 0.01), and the drop-out of readers smaller (0 vs 28%, p < .01).
Conclusions: Web-based learning is highly effective for teaching and harmonizing B-lines reading. Echocardiographers without previous experience with B-lines learn quickly.
Keywords: Certification; Lung comets; Quality control; Stress echocardiography; Wall motion.
Conflict of interest statement
Ethics approval and consent to participate
The study protocol was reviewed and approved by the institutional ethics committee as a part of the SE 2020 study (1487-CE Lazio-1, July 20, 2016).
Consent for publication
All the authors have read and approved the manuscript and accorded the consent for pubblication.
Competing interests
The authors declare that they have no competing interest.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Figures




References
-
- Sicari R, Nihoyannopoulos P, Evangelista A, Kasprzak J, Lancellotti P, Poldermans D. European Association of Echocardiography Stress echocardiography expert consensus statement: European Association of Echocardiography (EAE) (a registered branch of the ESC) Eur J Echocardiogr. 2008;9:415–437. doi: 10.1093/ejechocard/jen175. - DOI - PubMed
-
- Gottdiener JS, Bednarz J, Devereux R, Gardin J, Klein A, Manning WJ, et al. American Society of Echocardiography. American Society of Echocardiography recommendations for use of echocardiography in clinical trials. J Am Soc Echocardiogr. 2004;17:1086–1119. - PubMed
-
- Galderisi M, Henein MY, D' hooge J, Sicari R, Badano LP, Zamorano JL, Roelandt J. Recommendations of the European Association of Echocardiography. How to use echo-Doppler in clinical trials: different modalities for different purposes. Eur J Echocardiogr. 2011;12:339–353. doi: 10.1093/ejechocard/jer051. - DOI - PubMed
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Miscellaneous