Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2009 Aug;99(8):1515-21.
doi: 10.2105/AJPH.2007.111138. Epub 2008 Nov 13.

The effects of failing to include hard-to-reach respondents in longitudinal surveys

Donna H Odierna  1 , Laura A Schmidt
Affiliations

The effects of failing to include hard-to-reach respondents in longitudinal surveys

Donna H Odierna et al. Am J Public Health. 2009 Aug.

Abstract

Objectives: We sought to determine whether failure to locate hard-to-reach respondents in longitudinal studies causes biased and inaccurate study results.

Methods: We performed a nonresponse simulation in a survey of 498 low-income women who received cash aid in a California county. Our simulation was based on a previously published analysis that found that women without children who applied for General Assistance experienced more violence than did women with children who applied for Temporary Assistance to Needy Families. We compared hard-to-reach respondents whom we reinterviewed only after extended follow-up effort 12 months after baseline with other respondents. We then removed these hard-to-reach respondents from our analysis.

Results: Other than having a greater prevalence of substance dependence (14% vs 6%), there were no significant differences between hard- and easy-to-reach respondents. However, excluding the hard to reach would have decreased response rates from 89% to 71% and nullified the findings, a result that did not stem primarily from reduced statistical power.

Conclusions: The effects of failure to retain hard-to-reach respondents are not predicable based on respondent characteristics. Retention of these respondents should be a priority in public health research.

PubMed Disclaimer

References

    1. Sullivan CM, Rumptz M, Campbell R, Eby K, Davidson WS., II Retaining participants in longitudinal community research: a comprehensive protocol. J Appl Behav Sci 1996;32:262–276
    1. Lepkowski JM, Couer MP. Nonresponse in the second wave of longitudinal household surveys. Groves RM, Dillman D, Eltinge J, Little RJA, eds.Survey Nonresponse. New York, NY: John Wiley & Sons; 2002:259–272
    1. Mainieri T, Danziger S. Designing Surveys of Welfare Populations: Report From the Workshop on Designing Surveys of Welfare Recipients, March 15–16, 2001. Ann Arbor, MI: Center on Poverty, Risk, and Mental Health, Population Studies Center, Institute for Social Research, University of Michigan; February 26, 2002. Report number 02–509. Available at http://www.fordschool.umich.edu/research/poverty/pdf/surveys-aspe-worksh.... Accessed April 19, 2008
    1. Fitzgerald J, Gottschalk P, Moffit R. An analysis of sample attrition in panel data: the Michigan Study of Income Dynamics. J Hum Resources 1998;33:251–299
    1. Hochstim JR. A critical comparison of three strategies of collecting data from households. J Am Stat Assoc 1967;62:976–989