Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2020 Feb 5;20(1):22.
doi: 10.1186/s12874-020-0913-7.

A systematic review of methodology used in the development of prediction models for future asthma exacerbation

Joshua Bridge  1 , John D Blakey  2   3 , Laura J Bonnett  4
Affiliations

A systematic review of methodology used in the development of prediction models for future asthma exacerbation

Joshua Bridge et al. BMC Med Res Methodol. .

Abstract

Background: Clinical prediction models are widely used to guide medical advice and therapeutic interventions. Asthma is one of the most common chronic diseases globally and is characterised by acute deteriorations. These exacerbations are largely preventable, so there is interest in using clinical prediction models in this area. The objective of this review was to identify studies which have developed such models, determine whether consistent and appropriate methodology was used and whether statistically reliable prognostic models exist.

Methods: We searched online databases MEDLINE (1948 onwards), CINAHL Plus (1937 onwards), The Cochrane Library, Web of Science (1898 onwards) and ClinicalTrials.gov, using index terms relating to asthma and prognosis. Data was extracted and assessment of quality was based on GRADE and an early version of PROBAST (Prediction study Risk of Bias Assessment Tool). A meta-analysis of the discrimination and calibration measures was carried out to determine overall performance across models.

Results: Ten unique prognostic models were identified. GRADE identified moderate risk of bias in two of the studies, but more detailed quality assessment via PROBAST highlighted that most models were developed using highly selected and small datasets, incompletely recorded predictors and outcomes, and incomplete methodology. None of the identified models modelled recurrent exacerbations, instead favouring either presence/absence of an event, or time to first or specified event. Preferred methodologies were logistic regression and Cox proportional hazards regression. The overall pooled c-statistic was 0.77 (95% confidence interval 0.73 to 0.80), though individually some models performed no better than chance. The meta-analysis had an I2 value of 99.75% indicating a high amount of heterogeneity between studies. The majority of studies were small and did not include internal or external validation, therefore the individual performance measures are likely to be optimistic.

Conclusions: Current prognostic models for asthma exacerbations are heterogeneous in methodology, but reported c-statistics suggest a clinically useful model could be created. Studies were consistent in lacking robust validation and in not modelling serial events. Further research is required with respect to incorporating recurrent events, and to externally validate tools in large representative populations to demonstrate the generalizability of published results.

Keywords: Asthma; Clinical prediction; Exacerbation; Prognostic models; Risk; Systematic review.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
PRISMA flow diagram
Fig. 2
Fig. 2
Forest plot of the meta-analysis
Fig. 3
Fig. 3
Funnel plot of all models reported in the studies
See this image and copyright information in PMC

References

    1. Global Asthma Network . The global asthma report 2018. 2018.
    1. James AL, Palmer LJ, Kicic E, Maxwell PS, Lagan SE, Ryan GF, et al. Decline in lung function in the Busselton health study: the effects of asthma and cigarette smoking. Am J Respir Crit Care Med. 2005;171(2):109–114. doi: 10.1164/rccm.200402-230OC. - DOI - PubMed
    1. O'Byrne PM, Pedersen S, Lamm CJ, Tan WC, Busse WW. Severe exacerbations and decline in lung function in asthma. Am J Respir Crit Care Med. 2009;179(1):19–24. doi: 10.1164/rccm.200807-1126OC. - DOI - PubMed
    1. Bai T, Vonk J, Postma D, Boezen H. Severe exacerbations predict excess lung function decline in asthma. Eur Respir J. 2007;30:452–456. doi: 10.1183/09031936.00165106. - DOI - PubMed
    1. Thomas M, Bruton A, Moffatt M, Cleland J. Asthma and psychological dysfunction. Prim Care Respir J. 2011;20(3):250. doi: 10.4104/pcrj.2011.00058. - DOI - PMC - PubMed

Publication types