Navigating the swampy lowland: a framework for evaluating the effect of community mobilisation in female sex workers in Avahan, the India AIDS Initiative

Abstract

Background: Few models of how community mobilisation works have been elaborated in the scientific literature, and evaluation of the impact of these programmes on HIV and other health outcomes is extremely limited. Avahan, the India AIDS Initiative, has been implementing community mobilisation as part of its prevention programming with groups of high-risk individuals across six states since 2005.

Purpose: To articulate a programme theory and evaluation framework for evaluation of Avahan's approach to community mobilisation among female sex workers in four southern states in India.

Methods: The authors use a goal-based evaluation approach to describe the programme goals and an underlying programme theory that specifies how the programme is expected to work. Using multilevel structural equation modelling with propensity score matching, the evaluation will compare what is observed in the data with the predicted relationships specified by the model.

Results: The Avahan model of community mobilisation posits that meaningful participation in high-risk group intervention, structural intervention and organisational development activities leads to identification, collectivisation and ownership, which in turn leads to improved programme outcomes. Strong community groups and an enabling environment reinforce social norm and behaviour change outcomes and lead to sustained impact.

Discussion: Specifying an explicit programme theory can aid in the evaluation of complex interventions, especially when the evaluation design is observational. In addition to articulating Avahan's community mobilisation approach in a model that can be tested, we recommend some specific measures and methods that could be used to improve evaluation efforts in the future.

Figure 1

Understanding evaluation results using a goal-based evaluation framework. Adapted from Weiss.

Figure 2

Model of Avahan's programme theory for community mobilisation.

Figure 3

Relationship between the programme theory and the focus of the planned evaluation: key concepts, measures, level and source of data. STI, sexually transmitted infections.