A process evaluation plan for assessing a complex community-based maternal health intervention in Ogun State, Nigeria

Abstract

Background: Despite increased investment in community-level maternal health interventions, process evaluations of such interventions are uncommon, and can be instrumental in understanding mediating factors leading to outcomes. In Nigeria, where an unacceptably number of maternal deaths occur (maternal mortality ratio of 814/100,000 livebirths), the Community Level Interventions for Pre-eclampsia (CLIP) study (NCT01911494) aimed to reduce maternal and neonatal mortality and morbidity with a complex intervention of five interrelated components. Building from previous frameworks, we illustrate a methodology to evaluate implementation processes of the complex CLIP intervention, assess mechanisms of impact and identify emerging unintended causal pathways.

Methods: The study was conducted from 2013-2016 in five Local Government Areas in Ogun State, Nigeria. A six-step approach was developed to evaluate key constructs of context (external factors related to intervention), implementation (fidelity, dose, reach, and adaption) and mechanisms of impact (unintended outcomes and mediating pathways). The steps are: 1) describing the intervention by a logic model, 2) defining acceptable delivery, 3) formulating questions, 4) determining methodology, 5) planning resources in context, lastly, step 6) finalising the plan in consideration with relevant stakeholders.

Results: Quantitative data were collected from 32,785 antenatal and postnatal visits at the primary health care level, from 66 community engagement sessions, training assessments of community health workers, and standard health facility questionnaires. Forty-three focus group discussions, 38 in-depth interviews, and 23 structured observations were conducted to capture qualitative data. A total of 103 community engagement reports and 182 suspected pre-eclampsia case reports were purposively collected. Timing of data collection was staggered to understand feedback mechanisms that may have resulted from the delivery of the intervention. Data will be analysed using R and NVivo. Diffusions of innovations and realist evaluation theories will underpin analysis of the interaction between context, mechanisms and outcomes.

Conclusion: This comprehensive approach can serve as a guide for researchers and policy makers to plan the evaluation of similar complex health interventions in resource-constrained settings, and to aid in measuring 'effectiveness' of interventions and not just 'efficacy'.

Trial registration: This research is a part of the Community Level Interventions for Pre-eclampsia Study, NCT01911494. The trial is registered in Clinicaltrials.gov, the URL is https://clinicaltrials.gov/ct2/show/NCT01911494 The trial was registered on June 28, 2013 and the first participant was enrolled for intervention on March 1, 2014.

Keywords: Complex interventions; Implementation research; Maternal health; Nigeria; Ogun; Process evaluation.

Fig. 1

Logic model of the CLIP intervention in Ogun, Nigeria

Fig. 2

Constructs of process evaluation for the CLIP intervention in Ogun State: The key functions assessed will be implementation (the infrastructure through which intervention is delivered, how it is delivered and the ‘what’ ‘quantity and quality’ of intervention), mechanisms of impact (how interaction between intervention activities and participants effect outcomes), and context (evaluating external factors which shape or may be shaped by intervention). As evident, these functions are non-linear and mutually-informative