Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 May;30(5):1440-1447.
doi: 10.1038/s41591-024-02905-y. Epub 2024 Apr 18.

Development and validation of a new algorithm for improved cardiovascular risk prediction

Affiliations

Development and validation of a new algorithm for improved cardiovascular risk prediction

Julia Hippisley-Cox et al. Nat Med. 2024 May.

Abstract

QRISK algorithms use data from millions of people to help clinicians identify individuals at high risk of cardiovascular disease (CVD). Here, we derive and externally validate a new algorithm, which we have named QR4, that incorporates novel risk factors to estimate 10-year CVD risk separately for men and women. Health data from 9.98 million and 6.79 million adults from the United Kingdom were used for derivation and validation of the algorithm, respectively. Cause-specific Cox models were used to develop models to predict CVD risk, and the performance of QR4 was compared with version 3 of QRISK, Systematic Coronary Risk Evaluation 2 (SCORE2) and atherosclerotic cardiovascular disease (ASCVD) risk scores. We identified seven novel risk factors in models for both men and women (brain cancer, lung cancer, Down syndrome, blood cancer, chronic obstructive pulmonary disease, oral cancer and learning disability) and two additional novel risk factors in women (pre-eclampsia and postnatal depression). On external validation, QR4 had a higher C statistic than QRISK3 in both women (0.835 (95% confidence interval (CI), 0.833-0.837) and 0.831 (95% CI, 0.829-0.832) for QR4 and QRISK3, respectively) and men (0.814 (95% CI, 0.812-0.816) and 0.812 (95% CI, 0.810-0.814) for QR4 and QRISK3, respectively). QR4 was also more accurate than the ASCVD and SCORE2 risk scores in both men and women. The QR4 risk score identifies new risk groups and provides superior CVD risk prediction in the United Kingdom compared with other international scoring systems for CVD risk.

PubMed Disclaimer

Conflict of interest statement

All authors have completed the International Committee of Medical Journal Editors uniform disclosure form at https://www.icmje.org/coi_disclosure.pdf. J.H.-C. reports grants from the National Institute for Health Research, John Fell Oxford University Press Research Fund, Cancer Research UK (C5255/A18085), Wellcome Institutional Strategic Support Fund (204826/Z/16/Z) and other research councils during the conduct of the study. J.H.-C. is an unpaid director of QResearch, a not-for-profit organization that is a partnership between the University of Oxford and EMIS Health, which supplied the QResearch database used in this work. Until 9 August 2023, J.H.-C. had a 50% shareholding in ClinRisk and co-owned it with her husband, who was an executive director. On 9 August 2023, 100% of the share capital was donated to Endeavour Health Care Charitable Trust, and the company was renamed Endeavour Predict. J.H.-C. is an unpaid consultant to Endeavour Predict, and her husband is a nonexecutive director to cover the transition. The company licenses software both to the private sector and to NHS bodies or bodies that provide services to the NHS (through GP electronic health records providers, pharmacies, hospital providers and other NHS providers). This software implements algorithms (including QRISK3) that were developed from the QResearch database during her time at the University of Nottingham. C.A.C.C. reports receiving personal fees from ClinRisk outside of this work. K.M.C. reports grant funding from the British Heart Foundation and is an academic cofounder, shareholder and the director of Caristo Diagnostics, a University of Oxford cardiac image analysis spin-out company. M.B. received grants paid to her institution from AstraZeneca, Roche, Asthma + Lung UK and Horizon Europe, consulting fees or honoraria paid to her institution from AstraZeneca, Sanofi, GSK and Areteia, and support from Chiesi for attending meetings.

Figures

Fig. 1
Fig. 1. Final model-adjusted hazard ratios for CVD.
Adjusted hazard ratios in 5,155,595 women and 4,820,711 men, presented at the mean age of 39 years for variables with age interactions. The hazard ratios were adjusted for fractional polynomial terms for age and BMI (see Supplementary Fig. 1, which shows the relevant fractional polynomial terms). SBP is per 20-unit increase. Adj HR, adjusted hazard ratio; FH of CHD, family history of coronary heart disease.
Fig. 2
Fig. 2. Effect of the new risk factors on prediction of 10-year CVD absolute risk.
Ten-year CVD risk predictions for men and women over different ages. Predictions for an individual with each of the new risk factors are compared to those of a similar individual of the same age but without the new risk factors (reference individual). In this analysis, the reference individual is a White nonsmoker and has no adverse health conditions, an SBP of 125 mm Hg, a cholesterol/HDL ratio of 4.0 and a BMI of 25 kg m−2.
Fig. 3
Fig. 3. Decision curves for QR4, QRISK3 and Model A.
Decision curves showing net benefit in men and women aged 18–84 years in England and the devolved administrations. Decision curves for QR4, QRISK3 and Model A are compared to those for ‘Treat All’ (intervention in all individuals irrespective of risk threshold) and ‘Treat None’ (intervention in no individuals).
Fig. 4
Fig. 4. Calibration of QRISK3 and QR4.
Centile calibration plots of the observed and predicted risks for QR4 and QRISK3 in men and women aged 18–84 years in the English validation cohort. The red crosses show the observed risk versus the 10-year risk of CVD at each level of mean predicted risk. The blue line shows a perfect calibration scenario in which the mean predicted risk is equal to the observed risk.
Extended Data Fig. 1
Extended Data Fig. 1. CVD (primary outcome) and non-CVD death rates per 1000 by calendar year and month over the full study period in the English derivation cohort in those aged 18–84 years.
The two red spikes on the monthly graph show the non-CVD deaths occurring during the first and second COVID-19 pandemic waves in April 2020 and Jan 2021. Data presented in left panel are mean rates with 95% confidence intervals.
Extended Data Fig. 2
Extended Data Fig. 2. Adjusted hazard ratios for CVD risk for fractional polynomial terms for age and BMI and age interactions in the derivation cohort.
Fractional polynomial terms for adjusted hazard ratios for CVD risk for age, BMI and age interactions in the derivation cohort.
Extended Data Fig. 3
Extended Data Fig. 3. Decision curves for QR4, ASCVD and SCORE2 in people aged 40+ in the England validation cohort using the primary CVD outcome definition.
The greatest net benefit is observed for QR4 followed by ASCVD followed by SCORE2.
Extended Data Fig. 4
Extended Data Fig. 4. Predicted and observed 10-year CVD risks for ASCVD and SCORE2 in the English validation cohort in people aged 40+ using the primary CVD outcome.
Predicted and observed 10-year CVD risks for ASCVD and SCORE2 in the cohorts from England in people aged 40+ using the primary CVD outcome definition.

Similar articles

Cited by

References

    1. Cardiovascular diseases (CVDs). World Health Organizationwww.who.int/news-room/fact-sheets/detail/cardiovascular-diseases-(cvds) (2021).
    1. Roth GA, Mensah GA, Fuster V. The global burden of cardiovascular diseases and risks: a compass for global action. J. Am. Coll. Cardiol. 2020;76:2980–2981. doi: 10.1016/j.jacc.2020.11.021. - DOI - PubMed
    1. Goff DC, Jr, et al. 2013 ACC/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. J. Am. Coll. Cardiol. 2014;63:2935–2959. doi: 10.1016/j.jacc.2013.11.005. - DOI - PMC - PubMed
    1. SCORE2 Working Group & ESC Cardiovascular risk collaboration. SCORE2 risk prediction algorithms: new models to estimate 10-year risk of cardiovascular disease in Europe. Eur. Heart J. 42, 2439–2454 (2021). - PMC - PubMed
    1. NICE Guideline [NG238]. Cardiovascular Disease: Risk Assessment and Reduction, Including Lipid Modification (National Institute for Clinical Excellence, 2023); www.nice.org.uk/guidance/ng238 - PubMed

Publication types