Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 May-Jun;28(3):309-316.
doi: 10.1097/PHH.0000000000001512.

Transitioning the Healthy Chicago Survey From a Telephone Mode to Self-administered by Mail Mode

Jennifer Unangst  1 , Taylor Lewis, Emily Laflamme, Nik Prachand, Kingsley Weaver
Affiliations

Transitioning the Healthy Chicago Survey From a Telephone Mode to Self-administered by Mail Mode

Jennifer Unangst et al. J Public Health Manag Pract. 2022 May-Jun.

Abstract

Context: As response rates to health surveys conducted by telephone continue to decline and costs continue to increase, practitioners are increasingly considering a transition to self-administered mail contact modes.

Objective: To compare empirical differences observed across adjacent administrations of the Healthy Chicago Survey (HCS) conducted by telephone versus self-administered via mail contact.

Design: Data from the 2016, 2018, and 2020 administrations of the HCS are contrasted, and demographic distributions are benchmarked against the American Community Survey to investigate differences that may be linked to the HCS' transition from a telephone to self-administered mail mode between 2018 and 2020.

Setting: All survey data were collected from adult residents of Chicago, Illinois, between 2016 and 2020.

Main outcome measures: Costs, response rates, key health statistics, demographic distributions, and measures of precision generated from the HCS.

Results: The mail mode led to a response rate increase of 6.8% to 38.2% at half the cost per complete. Mail respondents are more likely to be nonminority, female, and hold a college degree. Key health statistic differences are mixed, but design effects are larger in the mail mode, which we attribute to more detailed geographic stratification and weighting employed in 2020.

Conclusions: The mail mode is a less costly data collection strategy for the HCS, but it comes with trade-offs. The quasi-random selection of an individual in the household exacerbates sociodemographic distribution disparities.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflicts of interest.

References

    1. Groves RM, Peytcheva E. The impact of nonresponse rates on nonresponse bias: a meta-analysis. Public Opin Q. 2008;72(2):167–189.
    1. Olson K, Smyth JD, Horwitz R, et al. Transitions from telephone surveys to self-administered and mixed-mode surveys: AAPOR Task Force Report. J Surv Stat Methodol. 2021;9(3):381–411.
    1. Harter R, Battaglia MP, Buskirk TD, et al. AAPOR report: address-based sampling. AAPOR ABS Task Force Report. https://www.aapor.org/Education-Resources/Reports/Address-based-Sampling... . Accessed September 20, 2021.
    1. Biemer PP, Murphy J, Zimmer S, et al. Using bonus monetary incentives to encourage Web response in mixed-mode household surveys. J Surv Stat Methodol. 2018;6(2):240–261.
    1. Link MW, Battaglia MP, Frankel MR, et al. A comparison of address-based sampling (ABS) versus random-digit dialing (RDD) for general population surveys. Public Opin Q. 2008;72(1):6–27.