Vouchers for scaling up insecticide-treated nets in Tanzania: methods for monitoring and evaluation of a national health system intervention

Abstract

Background: The Tanzania National Voucher Scheme (TNVS) uses the public health system and the commercial sector to deliver subsidised insecticide-treated nets (ITNs) to pregnant women. The system began operation in October 2004 and by May 2006 was operating in all districts in the country. Evaluating complex public health interventions which operate at national level requires a multidisciplinary approach, novel methods, and collaboration with implementers to support the timely translation of findings into programme changes. This paper describes this novel approach to delivering ITNs and the design of the monitoring and evaluation (M&E).

Methods: A comprehensive and multidisciplinary M&E design was developed collaboratively between researchers and the National Malaria Control Programme. Five main domains of investigation were identified: (1) ITN coverage among target groups, (2) provision and use of reproductive and child health services, (3) "leakage" of vouchers, (4) the commercial ITN market, and (5) cost and cost-effectiveness of the scheme.

Results: The evaluation plan combined quantitative (household and facility surveys, voucher tracking, retail census and cost analysis) and qualitative (focus groups and in-depth interviews) methods. This plan was defined in collaboration with implementing partners but undertaken independently. Findings were reported regularly to the national malaria control programme and partners, and used to modify the implementation strategy over time.

Conclusion: The M&E of the TNVS is a potential model for generating information to guide national and international programmers about options for delivering priority interventions. It is independent, comprehensive, provides timely results, includes information on intermediate processes to allow implementation to be modified, measures leakage as well as coverage, and measures progress over time.

Figure 1

The Hati Punguzo scheme.

Figure 2

The voucher flow.

Figure 3

Intermediate processes involved in achieving programme outcome.

Figure 4

Schedule of fieldwork and reporting (actual).