Quasi-experimental study designs series-paper 5: a checklist for classifying studies evaluating the effects on health interventions-a taxonomy without labels
- PMID: 28351692
- PMCID: PMC5669452
- DOI: 10.1016/j.jclinepi.2017.02.016
Quasi-experimental study designs series-paper 5: a checklist for classifying studies evaluating the effects on health interventions-a taxonomy without labels
Abstract
Objectives: The aim of the study was to extend a previously published checklist of study design features to include study designs often used by health systems researchers and economists. Our intention is to help review authors in any field to set eligibility criteria for studies to include in a systematic review that relate directly to the intrinsic strength of the studies in inferring causality. We also seek to clarify key equivalences and differences in terminology used by different research communities.
Study design and setting: Expert consensus meeting.
Results: The checklist comprises seven questions, each with a list of response items, addressing: clustering of an intervention as an aspect of allocation or due to the intrinsic nature of the delivery of the intervention; for whom, and when, outcome data are available; how the intervention effect was estimated; the principle underlying control for confounding; how groups were formed; the features of a study carried out after it was designed; and the variables measured before intervention.
Conclusion: The checklist clarifies the basis of credible quasi-experimental studies, reconciling different terminology used in different fields of investigation and facilitating communications across research communities. By applying the checklist, review authors' attention is also directed to the assumptions underpinning the methods for inferring causality.
Keywords: Evaluation; Health care; Health system; Nonrandomized; Quasi-experimental; Study design.
Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.
Similar articles
-
Quasi-experimental study designs series-paper 11: supporting the production and use of health systems research syntheses that draw on quasi-experimental study designs.J Clin Epidemiol. 2017 Sep;89:92-97. doi: 10.1016/j.jclinepi.2017.03.014. Epub 2017 Mar 29. J Clin Epidemiol. 2017. PMID: 28365304 Review.
-
Inclusion of quasi-experimental studies in systematic reviews of health systems research.Health Policy. 2015 Apr;119(4):511-21. doi: 10.1016/j.healthpol.2014.10.006. Epub 2014 Oct 22. Health Policy. 2015. PMID: 25776033
-
How has the impact of 'care pathway technologies' on service integration in stroke care been measured and what is the strength of the evidence to support their effectiveness in this respect?Int J Evid Based Healthc. 2008 Mar;6(1):78-110. doi: 10.1111/j.1744-1609.2007.00098.x. Int J Evid Based Healthc. 2008. PMID: 21631815
-
Quasi-experimental study designs series-paper 2: complementary approaches to advancing global health knowledge.J Clin Epidemiol. 2017 Sep;89:12-16. doi: 10.1016/j.jclinepi.2017.03.015. Epub 2017 Mar 30. J Clin Epidemiol. 2017. PMID: 28365307
-
Nonrandomized studies are not always found even when selection criteria for health systems intervention reviews include them: a methodological study.J Clin Epidemiol. 2013 Apr;66(4):367-70. doi: 10.1016/j.jclinepi.2012.11.009. Epub 2013 Feb 4. J Clin Epidemiol. 2013. PMID: 23380445 Review.
Cited by
-
Type of Track and Trigger system and incidence of in-hospital cardiac arrest: an observational registry-based study.BMC Health Serv Res. 2020 Sep 18;20(1):885. doi: 10.1186/s12913-020-05721-5. BMC Health Serv Res. 2020. PMID: 32948171 Free PMC article.
-
Community interventions with women's groups to improve women's and children's health in India: a mixed-methods systematic review of effects, enablers and barriers.BMJ Glob Health. 2020 Dec;5(12):e003304. doi: 10.1136/bmjgh-2020-003304. BMJ Glob Health. 2020. PMID: 33328199 Free PMC article.
-
Making better use of natural experimental evaluation in population health.BMJ. 2022 Oct 24;379:e070872. doi: 10.1136/bmj-2022-070872. BMJ. 2022. PMID: 36280251 Free PMC article. No abstract available.
-
Treatment Effects in Randomized and Nonrandomized Studies of Pharmacological Interventions: A Meta-Analysis.JAMA Netw Open. 2024 Sep 3;7(9):e2436230. doi: 10.1001/jamanetworkopen.2024.36230. JAMA Netw Open. 2024. PMID: 39331390 Free PMC article.
-
Associations of Stay-at-Home Order and Face-Masking Recommendation with Trends in Daily New Cases and Deaths of Laboratory-Confirmed COVID-19 in the United States.Explor Res Hypothesis Med. 2020 Jul 8:1-10. doi: 10.14218/ERHM.2020.00045. eCollection 2020 Jul 8. Explor Res Hypothesis Med. 2020. PMID: 32734759 Free PMC article.
References
-
- Reeves BC, Deeks JJ, Higgins JPT, Wells GA. Chapter 13: including non-randomized studies. In: Higgins JPT, Green S (editors), Cochrane handbook for systematic reviews of interventions. Version 5.0.2 (updated September 2009). The Cochrane Collaboration, 2009. Available at www.cochrane-handbook.org.
-
- Higgins J.P.T., Ramsay C., Reeves B.C., Shea B., Valentine J., Tugwell P. Issues relating to study design and risk of bias when including non-randomized studies in systematic reviews on the effects of interventions. Res Synth Methods. 2013;4:12–25. - PubMed
-
- Rockers P.C., Røttingen J.A., Shemilt I., Tugwell P., Bärnighausen T. Inclusion of quasi-experimental studies in systematic reviews of health systems research. Health Policy. 2015;19:511–521. - PubMed
-
- Bärnighausen T., Tugwell P., Røttingen J.A., Shemilt I., Rockers P., Geldsetzer P. Quasi-experimental study designs series - Paper 4: uses and value. J Clin Epidemiol. 2017;89:21–29. - PubMed
-
- Bärnighausen T., Oldenburg C., Tugwell P., Bommer C., Cara Ebert, Barreto M. Quasi-experimental study designs series - Paper 7: assessing the assumptions. J Clin Epidemiol. 2017;89:53–66. - PubMed
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical