Heterogeneity in the validity of administrative-based estimates of immunization coverage across health districts in Burkina Faso: implications for measurement, monitoring and planning

Abstract

Background: Data aggregation in national information systems begins at the district level. Decentralization has given districts a lead role in health planning and management, therefore validity of administrative-based estimates at that level is important to improve the performance of immunization information systems.

Objective: To assess the validity of administrative-based immunization estimates and their usability for planning and monitoring activities at district level.

Methods: DTP3 and measles coverage rates from administrative sources were compared with estimates from the EPI cluster survey (ECS) and Demographic and Health Survey (DHS) carried out in 2003 at national and regional levels. ECS estimates were compared with administrative rates across the 52 districts, which were classified into three groups: those where administrative rates were underestimating, overestimating or concordant with ECS estimates (differences within 95% CI of ECS rate).

Results: National rates provided by administrative data and ECS are similar (74% and 71% for DTP3 and 68% and 66% for measles, respectively); DHS estimates are much lower. Regional administrative data show large discrepancies when compared against ECS and DHS data (differences sometimes reaching 30 percentage points). At district level, geographical area is correlated with over- or underestimation by administrative sources, which overestimate DTP3 and measles coverage in remote areas. Underestimation is observed in districts near urban and highly populated centres. Over- and underestimation are independent of the antigen under consideration.

Conclusions: Variability in immunization coverage across districts highlights the limitations of using nationally aggregated indicators. If district data are to be used in monitoring and planning immunization programmes as intended by decentralization, heterogeneity in their validity must be reduced. The authors recommend: (1) strengthening administrative data systems; (2) implementing indicators that are insensitive to population mobility; (3) integrating surveys into monitoring processes at the subnational level; (4) actively promoting the use of coverage information by local personnel and district-level staff.

Figure 1

Data collection periods and targeted children cohorts, by source of data: administrative, DHS and ECS

Figure 2

Coverage gap between the worst and the best performing districts in each region (EPI cluster survey 2003)

Figure 3

Difference in estimates provided by ECS and DHS by region and antigen

Figure 4

Percentage gap between administrative rates (mean 2002–03) and survey rates—DTP3

Figure 5

Percentage gap between administrative rates (mean 2002–03) and survey rates—measles

Figure 6

Level of concordance of estimates: DTP3 coverage rate according to administrative data (mean 2002–03) and to the EPI survey data (2003)

Figure 7

Level of concordance of estimates: measles coverage rate according to administrative data (mean 2002–03) and to the EPI survey data (2003)