Comparison of three rapid household survey sampling methods for vaccination coverage assessment in a peri-urban setting in Pakistan

Abstract

Background: Household surveys are an essential tool for vaccine coverage monitoring in developing countries, and the World Health Organization (WHO) Expanded Program on Immunization (EPI) cluster survey design has been a default choice for decades. In response to methodological limitations of the traditional EPI sampling, alternative methods have been proposed, based on modern statistical and geographical techniques. This study compared the coverage estimates and the time efficiency of the EPI sampling design and two alternative methods: the compact segment sampling and innovative grid-based geographical information system (GIS) sampling.

Methods: We conducted a series of equal-sized concurrent prospective vaccine coverage surveys in Karachi, Pakistan, from January to December 2016, using traditional EPI, compact segment and grid-based GIS sampling methods.

Results: No differences in vaccine coverage estimates were identified across sampling methods in the peri-urban setting; however, due to stronger clustering effects and correct incorporation of sampling weights, the compact segment [design effect (DEFF) = 2.03] and the grid-based GIS surveys (DEFF = 1.72) had higher design effects and, therefore, appeared to have lower statistical precision than the traditional EPI surveys (DEFF = 1.57). To achieve the same level of apparent precision, data collection activities in the compact segment surveys would require more than twice the implementation time needed compared with the traditional EPI surveys.

Conclusions: The precision of the EPI surveys appeared higher than that of the alternative methods because, under a questionable self-weighting assumption, the estimated design effect did not account for variable sampling weights. The compact segment and grid-based GIS methods were designed to improve randomness and representativeness of sampling households. Although these alternative methods did not result in coverage estimates that differed from the EPI survey results in the peri-urban setting, they have a lower risk of selection bias and therefore may be preferred.

Keywords: Immunization programmes; Pakistan; epidemiological methods; probability sample; survey; vaccine coverage.