Bah humbug! Association between sending Christmas cards to trial participants and trial retention: randomised study within a trial conducted simultaneously across eight host trials

Abstract

Objectives: To determine the effectiveness of sending Christmas cards to participants in randomised controlled trials to increase retention rate at follow-ups, and to explore the feasibility of doing a study within a trial (SWAT) across multiple host trials simultaneously.

Design: Randomised SWAT conducted simultaneously across eight host trials.

Setting: Eight randomised controlled trials researching various areas including surgery and smoking cessation.

Participants: 3223 trial participants who were still due at least one follow-up from their host randomised controlled trial.

Intervention: Participants were randomised (1:1, separately by each host trial) to either received a Christmas card in mid-December 2019 or to not receive a card.

Main outcome measure: Proportion of participants completing their next follow-up (retention rate) within their host randomised controlled trial.

Results: 1469 participants (age 16-94 years; 70% (n=1033) female; 96% (813/847) white ethnicity) across the eight host randomised controlled trials were involved in the analysis (cut short owing to covid-19). No evidence was found of a difference in retention rate between the two arms for any of the host trials when analysed separately or when the results were combined (85.3% (639/749) for cards versus 85.4% (615/720) for no card; odds ratio 0.96, 95% confidence interval 0.71 to 1.29; P=0.77). No difference was observed when comparing just participants who were due a follow-up in the 30 days after receiving the card (odds ratio 0.96, 0.42 to 2.21). No evidence of a difference in time to complete the questionnaire was found (hazard ratio 1.01, 95% confidence interval 0.91 to 1.13; P=0.80). These results were robust to post hoc sensitivity analyses. The cost of this intervention was £0.76 (€0.91; $1.02) per participant, and it will have a carbon footprint of approximately 140 g CO₂ equivalent per card. One benefit of this approach was the need to only submit one ethics application.

Conclusions: Sending Christmas cards to participants in randomised controlled trials does not increase retention. Undertaking a SWAT within multiple randomised controlled trials at the same time is, however, possible. This approach should be used more often to build an evidence base to support selection of recruitment and retention strategies. Although no evidence of a boost to retention was found, embedding a SWAT in multiple host trials simultaneously has been shown to be possible.

Study registration: SWAT repository https://www.qub.ac.uk/sites/TheNorthernIrelandNetworkforTrialsMethodologyResearch/FileStore/Filetoupload,846275,en.pdf#search=SWAT%2082.

Fig 1

Front of Christmas card

Fig 2

Flow of participants through study within a trial

Fig 3

Cumulative meta-analysis of primary outcome (completion rate)

Fig 4

Cumulative meta-analysis of secondary outcome (time to completion)