Process evaluation design in a cluster randomised controlled childhood obesity prevention trial: the WAVES study

Abstract

Background: The implementation of a complex intervention is heavily influenced by individual context. Variation in implementation and tailoring of the intervention to the particular context will occur, even in a trial setting. It is recognised that in trials, evaluating the process of implementation of a complex intervention is important, yet process evaluation methods are rarely reported. The WAVES study is a cluster randomised controlled trial to evaluate the effectiveness of an obesity prevention intervention programme targeting children aged 6-7 years, delivered by teachers in primary schools across the West Midlands, UK. The intervention promoted activities encouraging physical activity and healthy eating. This paper presents the methods used to assess implementation of the intervention.

Methods: Previous literature was used to identify the dimensions of intervention process and implementation to be assessed, including adherence, exposure, quality of delivery, participant responsiveness, context, and programme differentiation.

Results: Multiple methods and tools were developed to capture information on all these dimensions. These included observations, logbooks, qualitative evaluation, questionnaires and research team reflection.

Discussion: Data collection posed several challenges, predominantly when relying on teachers to complete paperwork, which they saw as burdensome on top of their teaching responsibilities. However, the use of multiple methods helped to ensure data on each dimension, where possible, was collected using more than one method. This also allowed for triangulation of the findings when several data sources on any one dimension were available.

Conclusions: We have reported a comprehensive approach to the assessment of the implementation and processes of a complex childhood obesity prevention intervention within a cluster randomised controlled trial. These approaches can be transferred and adapted for use in other complex intervention trials.

Trial registration number: ISRCTN97000586.

Figure 1

Sources of information used to inform the WAVES study intervention process evaluation. DoE: Diary of Experiences. LB: Logbooks. MVPA: Moderate to Vigorous Physical Activity. Obs: Observation checklist. PA: Physical Activity. PE: Parent Evaluation. Qual: Qualitative. SE: Staff Evaluation. RK: Researcher Knowledge. TQ: Teacher questionnaire.