Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2025 May 5:27:e60884.
doi: 10.2196/60884.

Viability of Web-Based Respondent-Driven Sampling of Belgian Men Who Have Sex With Men: Process Evaluation

Estrelle Thunnissen  1 , Veerle Buffel  2 , Linda Campbell  1 , Bea Vuylsteke  3 , Philippe Bos  1 , Edwin Wouters  1
Affiliations

Viability of Web-Based Respondent-Driven Sampling of Belgian Men Who Have Sex With Men: Process Evaluation

Estrelle Thunnissen et al. J Med Internet Res. .

Abstract

Background: Obtaining a representative sample is a substantial challenge when undertaking health research among hidden and hard-to-reach populations such as men who have sex with men Web-based respondent-driven sampling (WEB RDS) was developed to overcome such sampling challenges and to create population estimates based on network and sampling characteristics. Despite a decade of research, it remains unclear whether WEB RDS is suitable for sampling hidden populations such as men who have sex with men.

Objective: This study aims to evaluate how viable the WEB RDS methodology is for obtaining a nationwide sample of men who have sex with men, suitable for population inference of sexual health characteristics, in Belgium.

Methods: We adapted the Medical Resource Council process evaluation framework for interventions, to evaluate an empirical WEB RDS. Viewing "WEB RDS" as a complex intervention with respondent-driven recruitment as the aim, we evaluated indicators of context, implementation, mechanisms of impact, and performance. We analyzed the data using a mixed methods approach that integrated findings from quantitative analysis, such as RDS diagnostics, and qualitative thematic analysis.

Results: Sampling did not reach a sufficient sample size (n=193) to compensate for an RDS design effect of 3 and the number of recruitment waves was low (waves=7). A visual examination of the convergence and bottleneck plots indicates that many more waves of recruitment would be needed for population estimates to become independent of the seeds. However, producing further waves was impeded by challenges inherent to the research context and process. Men who have sex with men and their community organization representatives indicated that, in Belgium, men who have sex with men are overresearched, with low motivation for the topic of sexual health and digital etiquette dictating not sharing survey links. A moderate reward of €10-€30 (US $11.2-$33.6) with a dual incentive structure was insufficient to overcome these barriers.

Conclusions: This study indicates that WEB RDS, even with a moderate incentive, is not a viable sampling strategy for obtaining valid population estimates of sexual health traits of men who have sex with men in Belgium. The study emphasizes the need to understand men who have sex with men research motivation and topic saliency. Additionally, the study highlights the importance of digital etiquette. Finally, the study showcases the use of the adapted Medical Research Council framework for evaluating WEB RDS methodology.

Keywords: Medical Resource Council framework; men who have sex with men; nonparticipation; overresearch; population inference; survey fatigue; web-based respondent-driven sampling.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest: None declared.

Figures

Figure 1
Figure 1
Web-based respondent-driven sampling evaluation framework.
Figure 2
Figure 2
All-point plot of age.
Figure 3
Figure 3
Bottleneck plot.
Figure 4
Figure 4
Recruitment tree.
Figure 5
Figure 5
Respondent drop-out.
Figure 6
Figure 6
Convergence plot.
See this image and copyright information in PMC

Similar articles

See all similar articles

References

    1. Abdul-Quader AS, Baughman AL, Hladik W. Estimating the size of key populations: current status and future possibilities. Curr Opin HIV AIDS. 2014;9(2):107–114. doi: 10.1097/COH.0000000000000041. https://europepmc.org/abstract/MED/24393694 - DOI - PMC - PubMed
    1. Mauck DE, Gebrezgi MT, Sheehan DM, Fennie KP, Ibañez GE, Fenkl EA, Trepka MJ. Population-based methods for estimating the number of men who have sex with men: a systematic review. Sex Health. 2019;16(6):527–538. doi: 10.1071/SH18172. https://europepmc.org/abstract/MED/31658435 SH18172 - DOI - PMC - PubMed
    1. De Schrijver L, Fomenko E, Krahé B, Dewaele A, Harb J, Janssen E, Motmans J, Roelens K, Vander Beken T, Keygnaert I. An assessment of the proportion of LGB+ persons in the Belgian population, their identification as sexual minority, mental health and experienced minority stress. BMC Public Health. 2022;22(1):1807. doi: 10.1186/s12889-022-14198-2.10.1186/s12889-022-14198-2 - DOI - PMC - PubMed
    1. Barros AB, Dias SF, Martins MRO. Hard-to-reach populations of men who have sex with men and sex workers: a systematic review on sampling methods. Syst Rev. 2015;4(1):141. doi: 10.1186/s13643-015-0129-9. https://systematicreviewsjournal.biomedcentral.com/articles/10.1186/s136... 10.1186/s13643-015-0129-9 - DOI - DOI - PMC - PubMed
    1. Schwarcz S, Spindler H, Scheer S, Valleroy L, Lansky A. Assessing representativeness of sampling methods for reaching men who have sex with men: a direct comparison of results obtained from convenience and probability samples. AIDS Behav. 2007;11(4):596–602. doi: 10.1007/s10461-007-9232-9. - DOI - PubMed

LinkOut - more resources