Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2023 Feb;30(2):183-195.
doi: 10.1016/j.acra.2022.09.004. Epub 2022 Oct 4.

Multiparametric Quantitative Imaging Biomarkers for Phenotype Classification: A Framework for Development and Validation

Affiliations
Review

Multiparametric Quantitative Imaging Biomarkers for Phenotype Classification: A Framework for Development and Validation

Jana G Delfino et al. Acad Radiol. 2023 Feb.

Abstract

This manuscript is the third in a five-part series related to statistical assessment methodology for technical performance of multi-parametric quantitative imaging biomarkers (mp-QIBs). We outline approaches and statistical methodologies for developing and evaluating a phenotype classification model from a set of multiparametric QIBs. We then describe validation studies of the classifier for precision, diagnostic accuracy, and interchangeability with a comparator classifier. We follow with an end-to-end real-world example of development and validation of a classifier for atherosclerotic plaque phenotypes. We consider diagnostic accuracy and interchangeability to be clinically meaningful claims for a phenotype classification model informed by mp-QIB inputs, aiming to provide tools to demonstrate agreement between imaging-derived characteristics and clinically established phenotypes. Understanding that we are working in an evolving field, we close our manuscript with an acknowledgement of existing challenges and a discussion of where additional work is needed. In particular, we discuss the challenges involved with technical performance and analytical validation of mp-QIBs. We intend for this manuscript to further advance the robust and promising science of multiparametric biomarker development.

Keywords: QIBA; multi-class classification; multi-parametric quantitative imaging biomarkers (mp-QIBs); multiparametric classification; phenotype classification.

PubMed Disclaimer

Conflict of interest statement

Declaration of interests

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Figures

Figure 1:
Figure 1:
An overview of the atherosclerotic plaque classification task. A) Standardized CTA images are acquired in accordance with the existing QIBA profile. B) Images are used to classify tissue type and location at each cross section along the vessel wall. Vessel morphology is validated against histological truth. C) Cross sectional views along the vessel depict tissue type and location as color overlays to the vessel wall. D) Area and location of tissue at each cross section is used as input into a convolutional neural network to generate a phenotype classification (subclinical, stable, unstable) at each vessel cross section. In this way, variations in raw images are filtered out, and focus remains on validated tissue characteristics. Phenotype classification is compared against agreement with an expert pathologist blinded to imaging results.

References

    1. Sullivan DC, Obuchowski NA, Kessler LG, et al. Metrology Standards for Quantitative Imaging Biomarkers [published online ahead of print 2015/08/13]. Radiology 2015;277(3):813–825. - PMC - PubMed
    1. Kessler LG, Barnhart HX, Buckler AJ, et al. The emerging science of quantitative imaging biomarkers terminology and definitions for scientific studies and regulatory submissions [published online ahead of print 2014/06/13]. Stat Methods Med Res 2015;24(1):9–26. - PubMed
    1. Raunig DL, McShane LM, Pennello G, et al. Quantitative imaging biomarkers: a review of statistical methods for technical performance assessment [published online ahead of print 2014/06/13]. Stat Methods Med Res 2015;24(1):27–67. - PMC - PubMed
    1. Obuchowski NA, Reeves AP, Huang EP, et al. Quantitative imaging biomarkers: a review of statistical methods for computer algorithm comparisons [published online ahead of print 2014/06/13]. Stat Methods Med Res 2015;24(1):68–106. - PMC - PubMed
    1. Obuchowski NA, Barnhart HX, Buckler AJ, et al. Statistical issues in the comparison of quantitative imaging biomarker algorithms using pulmonary nodule volume as an example [published online ahead of print 2014/06/13]. Stat Methods Med Res 2015;24(1):107–140. - PMC - PubMed