Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2021 Jan;116(1):191-199.
doi: 10.1111/add.15158. Epub 2020 Jul 8.

Comparison of a web-push survey research protocol with a mailed paper and pencil protocol in the Monitoring the Future panel survey

Affiliations

Comparison of a web-push survey research protocol with a mailed paper and pencil protocol in the Monitoring the Future panel survey

Megan E Patrick et al. Addiction. 2021 Jan.

Abstract

Aims: The experiment tested the effects of a web-push survey research protocol, compared with the standard mailed paper-and-pencil protocol, among young adults aged 19-30 years in the 'Monitoring the Future' (MTF) longitudinal study.

Design, setting and participants: The US-based MTF study has measured substance use trends among young adults in panel samples followed biennially, using consistent mailed survey procedures from 1977 to 2017. In 2018, young adult participants in the MTF longitudinal component scheduled to be surveyed at ages 19-30 in 2018 (from high school senior cohorts of 2006-17, n = 14 709) were randomly assigned to receive the standard mail/paper survey procedures or new web-push procedures.

Measurements: Primary outcomes were responding to the survey and prevalence estimates for past 30-day use of alcohol, cigarettes, marijuana and illicit drugs.

Findings: The web-push response rate was 39.07% [95% confidence interval (CI) = 37.889, 40.258]; this was significantly better than the standard MTF response rate of 35.12% (95% CI = 33.964, 36.285). After adjusting for covariates, the web-push condition was associated with a 19% increase in the odds of responding compared with standard MTF (adjusted odds ratio = 1.188; 95% CI = 1.096, 1.287). Substance use prevalence estimates were very similar and differences became negligible when using attrition weights and controlling for socio-demographic characteristics.

Conclusions: The web-push protocol produced a higher response rate than the mailed pencil and paper protocol in the Monitoring the Future panel study, without substantially affecting estimates of substance use once attrition weights and socio-demographic variables were factored in.

Keywords: longitudinal; paper survey; response rate; substance use estimates; survey research; web-based survey.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Response rate in 2018 by condition for each follow‐up/age group
Figure 2
Figure 2
Predicted probability of responding according to life‐time illicit drug use by treatment condition

Comment in

References

    1. Galea S., Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol 2007; 17: 643–653. - PubMed
    1. Keeter S., Kennedy C., Dimock M., Best J., Craighill P. Gauging the impact of growing nonresponse on estimates from a national RDD telephone survey. Public Opin Q 2006; 70: 759–779.
    1. Tolonen H., Helakorpi S., Talala K., Helasoja V., Martelin T., Prättälä R. 25‐year trends and socio‐demographic differences in response rates: Finnish adult health behaviour survey. Eur J Epidemiol 2006; 21: 409–415. - PubMed
    1. Schulenberg J. E., Johnston L. D., O'Malley P. M., Bachman J. G., Miech R. A., Patrick M. E. Monitoring the Future National Survey Results on Drug Use, 1975–2018: Volume II, College Students and Adults Ages 19–60. Ann Arbor, MI; Institute for Social Research, The University of Michigan; 2019.
    1. Patrick M. E., Couper M. P., Laetz V. B., Schulenberg J. E., O'Malley P. M., Johnston L. D., et al A sequential mixed‐mode experiment in the U.S. National Monitoring the future study. J Surv Stat Methodol 2018; 6: 72–97. - PMC - PubMed

Publication types