Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Dec 10;332(22):1900-1911.
doi: 10.1001/jama.2024.21060.

Electronic Nudges to Increase Influenza Vaccination in Patients With Chronic Diseases: A Randomized Clinical Trial

Affiliations

Electronic Nudges to Increase Influenza Vaccination in Patients With Chronic Diseases: A Randomized Clinical Trial

Niklas Dyrby Johansen et al. JAMA. .

Abstract

Importance: Despite strong worldwide guideline recommendations, influenza vaccination rates remain suboptimal among young and middle-aged patients with chronic diseases. Effective scalable strategies to increase vaccination are needed.

Objective: To investigate whether electronically delivered letter-based nudges informed by behavioral science could increase influenza vaccination uptake among patients aged 18 to 64 years with chronic diseases.

Design, setting, and participants: Nationwide pragmatic registry-based randomized clinical implementation trial conducted between September 24, 2023, and May 31, 2024, enrolling all Danish citizens aged 18 to 64 years who met criteria for free-of-charge influenza vaccination in light of preexisting chronic disease. All trial data were sourced from nationwide administrative health registries.

Intervention: Randomized in 2.45:1:1:1:1:1:1 ratio to no letter (usual care) or 6 different behaviorally informed electronic letters.

Main outcomes and measures: The primary end point was receipt of influenza vaccination on or before January 1, 2024, assessed in 7 prespecified coprimary comparisons (all intervention groups pooled vs usual care and each individual intervention group vs usual care). Absolute risk difference in proportions and a crude relative risk were calculated for each comparison.

Results: A total of 299 881 participants (53.2% [159 454] female, median age, 52.0 [IQR, 39.8-59.0] years) were randomized. Compared with usual care, influenza vaccination rates were higher among those receiving any intervention letter (any intervention letter, 39.6% vs usual care, 27.9%; difference, 11.7 percentage points; 99.29% CI, 11.2-12.2 percentage points; P < .001). Each individual letter type significantly increased influenza vaccination with the largest effect sizes observed with a repeated letter sent 10 days after the initial letter (repeated letter, 41.8% vs usual care, 27.9%; difference, 13.9 percentage points; 99.29% CI, 13.1-14.7 percentage points; P < .001) and a letter emphasizing potential cardiovascular benefits of vaccination (cardiovascular gain, 39.8% vs usual care, 27.9%; difference, 11.9 percentage points; 99.29% CI, 11.1-12.7 percentage points; P < .001). Vaccination rates were improved across major subgroups.

Conclusions and relevance: In a nationwide randomized clinical implementation trial, electronically delivered letter-based nudges markedly increased influenza vaccination compared with usual care among young and middle-aged patients with chronic diseases. The results of this study suggest that simple, scalable, and cost-efficient electronic letter strategies may have substantial public health implications.

Trial registration: ClinicalTrials.gov Identifier: NCT06030739.

PubMed Disclaimer

Conflict of interest statement

Conflict of Interest Disclosures: Dr Vaduganathan reported receiving research grant support from American Regent, Amgen, AstraZeneca, Bayer AG, Baxter Healthcare, BMS, Boehringer Ingelheim, Chiesi, Cytokinetics, Fresenius Medical Care, Idorsia Pharmaceuticals, Lexicon Pharmaceuticals, Merck, Milestone Pharmaceuticals, Novartis, Novo Nordisk, Pharmacosmos, Relypsa, Roche Diagnostics, Sanofi, and Tricog Health, serving on advisory boards and clinical trial committees or having speaker engagements and receiving grants from AstraZeneca, Galmed, Novartis, Bayer AG, Occlutech, and Impulse Dynamics outside the submitted work. Dr Bhatt reported receiving speaker engagement fees from Sanofi, Merck, and Novo Nordisk outside the submitted work. Dr Claggett reported receiving consulting fees from Alnylam, Cardurion, Corvia, Cytokinetics, Intellia, Rocket, CVRX, BMS, and Eli Lilly outside the submitted work. Dr Køber reported receiving speaker engagement fees from AstraZeneca, Boehringer Ingelheim, Novartis, and Novo Nordisk during the conduct of the study. Dr Solomon reported receiving grants from Alexion, Alnylam, Applied Therapeutics, AstraZeneca, Bellerophon, Bayer, BMS, Boston Scientific, Cytokinetics, Edgewise, Eidos/BridgeBio, Gossamer, GSK, Ionis, Lilly, National Institutes of Health/National Heart, Lung, and Blood Institute, Novartis, NovoNordisk, Respicardia, Sanofi Pasteur, Tenaya, Theracos, and US2.AI and personal fees from Abbott, Action, Akros, Alexion, Alnylam, Amgen, Arena, AstraZeneca, Bayer, BMS, Cardior, Cardurion, Corvia, Cytokinetics, GSK, Lilly, Novartis, Roche, Theracos, Quantum Genomics, Tenaya, Sanofi Pasteur, Dinaqor, Tremeau, CellProThera, Moderna, American Regent, Sarepta, Lexicon, Anacardio, Akros, and Valo outside the submitted work. Dr Biering-Sørensen reported receiving consulting fees and lecture fees from Sanofi Pasteur, grants from Sanofi Pasteur Research, consulting fees and lecture fees from GSK, grants from Pfizer Research, consulting fees from Novo Nordisk, grants from AstraZeneca Research and Boston Scientific Research, consulting fees from GE Healthcare, IQVIA, Parexel, and Amgen, lecture fees from CSL Seqirus, Bayer, and Novartis outside the submitted work. No other disclosures were reported.

Figures

Figure 1.
Figure 1.. Identification, Exclusion, and Randomization of Participants in the Trial
Eligible participants were randomized in a 2.45:1:1:1:1:1:1 ratio to either usual care or 6 different active groups, each receiving different behaviorally informed electronic letters nudging participants to make the decision to obtain influenza vaccination (letters are described in the Methods section). No exclusions were made after randomization and group assignment. Citizens may apply for an exemption from the electronic letter system to receive physical letters instead. Exemptions are granted for several reasons including physical or mental impairment and lack of computer/internet access.
Figure 2.
Figure 2.. Results for Primary End Point of Influenza Vaccination Receipt
The primary end point was receipt of influenza vaccination on or before January 1, 2024. A total of 7 prespecified comparisons were made and adjusted for multiplicity with each comparison performed at an α level of .0071. Nominal 99.29% CIs are reported to maintain an overall α level of .05 for the primary end point. Unadjusted P values are shown. The primary analyses shown in this Figure do not account for censoring. In total, during follow-up for receipt of influenza vaccination, 1008 participants (0.3%) died and 382 participants (0.1%) emigrated. CV indicates cardiovascular.
Figure 3.
Figure 3.. Results for 3 of 7 Comparisons for Secondary End Point of Time to Influenza Vaccination Receipts
The secondary end point was influenza vaccination modeled as a time-to-event outcome. Cumulative incidence curves were estimated using the Kaplan-Meier method. Time 0 was the date of initial intervention delivery for all participants (September 24, 2023). Participants were censored at end of follow-up (January 1, 2024), death, or emigration, whichever occurred first. The numbers at risk at baseline differ from the total number of randomized participants in each group due to censoring occurring on the first day of follow-up. Cox proportional hazards regression models were used to estimate hazard ratios (HRs). No violations of the proportional hazards assumption were found. A total of 7 prespecified comparisons were made and adjusted for multiplicity with each comparison performed at an α level of .0071. Nominal 99.29% CIs are reported to maintain an overall α level of .05 for the secondary end point. Unadjusted P values are shown.
Figure 4.
Figure 4.. Results for 4 of 7 Comparisons for Secondary End Point of Time to Influenza Vaccination Receipts
The secondary end point details are reported in the caption to Figure 3. CV indicates cardiovascular; HR, hazard ratio.
Figure 5.
Figure 5.. Primary End Point Across Prespecified Subgroups for Comparison of Any Intervention Letter vs Usual Care
We tested for homogeneous treatment effects across prespecified subgroups for the primary end point for the comparison of all intervention groups pooled vs usual care using binomial regression with identity link and interaction terms. Median age was 52.0 (IQR, 39.8-59.0) years. The P values shown are interaction P values.

References

    1. World Health Organization. Influenza (seasonal). October 3, 2023. Accessed January 19, 2024. https://www.who.int/news-room/fact-sheets/detail/influenza-(seasonal)
    1. Gross PA, Hermogenes AW, Sacks HS, Lau J, Levandowski RA. The efficacy of influenza vaccine in elderly persons. a meta-analysis and review of the literature. Ann Intern Med. 1995;123(7):518-527. doi: 10.7326/0003-4819-123-7-199510010-00008 - DOI - PubMed
    1. Rondy M, El Omeiri N, Thompson MG, Levêque A, Moren A, Sullivan SG. Effectiveness of influenza vaccines in preventing severe influenza illness among adults: a systematic review and meta-analysis of test-negative design case-control studies. J Infect. 2017;75(5):381-394. doi: 10.1016/j.jinf.2017.09.010 - DOI - PMC - PubMed
    1. McLean HQ, Petrie JG, Hanson KE, et al. Interim estimates of 2022-23 seasonal influenza vaccine effectiveness - Wisconsin, October 2022-February 2023. MMWR Morb Mortal Wkly Rep. 2023;72(8):201-205.. doi: 10.15585/mmwr.mm7208a1 - DOI - PMC - PubMed
    1. Fröbert O, Götberg M, Erlinge D, et al. Influenza vaccination after myocardial infarction: a randomized, double-blind, placebo-controlled, multicenter trial. Circulation. 2021;144(18):1476-1484. doi: 10.1161/CIRCULATIONAHA.121.057042 - DOI - PubMed

Publication types

MeSH terms

Substances

Associated data