Reach, engagement, and retention in an Internet-based weight loss program in a multi-site randomized controlled trial

Abstract

Background: Research increasingly supports the conclusion that well-designed programs delivered over the Internet can produce significant weight loss compared to randomized controlled conditions. Much less is known about four important issues addressed in this study: (1) which recruitment methods produce higher eHealth participation rates, (2) which patient characteristics are related to enrollment, (3) which characteristics are related to level of user engagement in the program, and (4) which characteristics are related to continued participation in project assessments.

Methods: We recruited overweight members of three health maintenance organizations (HMOs) to participate in an entirely Internet-mediated weight loss program developed by HealthMedia, Inc. Two different recruitment methods were used: personal letters from prevention directors in each HMO, and general notices in member newsletters. The personal letters were sent to members diagnosed with diabetes or heart disease and, in one HMO, to a general membership sample in a particular geographic location. Data were collected in the context of a 2x2 randomized controlled trial, with participants assigned to receive or not receive a goal setting intervention and a nutrition education intervention in addition to the basic program.

Results: A total of 2311 members enrolled. Bivariate analyses on aggregate data revealed that personalized mailings produced higher enrollment rates than member newsletters and that members with diabetes or heart disease were more likely to enroll than those without these diagnoses. In addition, males, those over age 60, smokers, and those estimated to have higher medical expenses were less likely to enroll (all P < .001). Males and those in the combined intervention were less likely to engage initially, or to continue to be engaged with their Web program, than other participants. In terms of retention, multiple logistic regressions revealed that enrollees under age 60 (P < .001) and those with higher baseline self-efficacy were less likely to participate in the 12-month follow-up (P = .03), but with these exceptions, those participating were very similar to those not participating in the follow-up.

Conclusions: A single personalized mailing increases enrollment in Internet-based weight loss. eHealth programs offer great potential for recruiting large numbers of participants, but they may not reach those at highest risk. Patient characteristics related to each of these important factors may be different, and more comprehensive analyses of determinants of enrollment, engagement, and retention in eHealth programs are needed.

Figure 1

CONSORT diagram of participant retention