Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2025 Nov 10;20(11):e0336612.
doi: 10.1371/journal.pone.0336612. eCollection 2025.

A national study of substance use: Demonstrated use of recommendations for best practice online data collection

Andrew P Bontemps  1 , Bailey E Pridgen  2 , William P Wagner  2 , Karen L Cropsey  2
Affiliations

A national study of substance use: Demonstrated use of recommendations for best practice online data collection

Andrew P Bontemps et al. PLoS One. .

Abstract

Objectives: Since the COVID-19 pandemic, more researchers have used to online data collection to recruit participants to research studies. However, one perceived limitation of online data collection is a belief that it results in lower quality data due to the introduction of bots or misrepresentation by participants to qualify for study compensation. The current study demonstrates that following recommendations for online data collection results in quick collection of a high-quality, diverse, multi-state sample.

Methods: The current study followed recommendations for best practice, advertising on social media sites combined with investigator-implemented (e.g., splash page, attention checks, use of physical payment) and built-in Qualtrics tools (e.g., IP tracking, CAPTCHA) to collect data from participants who use substances from 15 states within the United States examining cannabis use and perceptions of harm reduction interventions (HRIs).

Results: Before cleaning, 3,642 participants completed the screener across 172 days of survey up-time. After cleaning, the final sample included 639 responses in the final cannabis survey, and 1,137 responses in the final HRI survey including 264 participants completing both surveys. The study yielded approximately 8.8 cleaned surveys per day and a usable data rate of 60.3% for participants who completed the cannabis survey only, 72.4% for participants who completed the HRI survey only, and 72.6% for participants who completed both.

Conclusions: While every method of data collection has strengths and weaknesses, when implemented using appropriate tools to prevent completion of surveys by non-valid participants, internet-based data collection methods can provide researchers with relatively low-cost, high-quality samples.

PubMed Disclaimer

Conflict of interest statement

The authors have declared that no competing interests exist.

Figures

Fig 1
Fig 1. Consort diagram of participants.
See this image and copyright information in PMC

References

    1. Hawes ES, Mildrum Chana S, Faust A, Baker JC, Hendricks PS, Azuero A, et al. In vivo experience with NRT to increase adherence and smoking abstinence among individuals in the criminal legal system: study protocol for a randomized clinical trial. Front Psychiatry. 2022;13:886680. doi: 10.3389/fpsyt.2022.886680 - DOI - PMC - PubMed
    1. Arigo D, Pagoto S, Carter-Harris L, Lillie SE, Nebeker C. Using social media for health research: methodological and ethical considerations for recruitment and intervention delivery. Digit Health. 2018;4:2055207618771757. doi: 10.1177/2055207618771757 - DOI - PMC - PubMed
    1. King D, O’Rourke N, DeLongis A. Social media recruitment and online data collection: a beginner’s guide and best practices for accessing low-prevalence and hard-to-reach populations. Can Psychol. 2014;55:240–8.
    1. Newman A, Bavik YL, Mount M, Shao B. Data collection via online platforms: challenges and recommendations for future research. Appl Psychol. 2021;70(3):1380–402. doi: 10.1111/apps.12302 - DOI
    1. Peer E, Brandimarte L, Samat S, Acquisti A. Beyond the Turk: alternative platforms for crowdsourcing behavioral research. J Exp Soc Psychol. 2017;70:153–63. doi: 10.1016/j.jesp.2017.01.006 - DOI