Improving GRADE evidence tables part 2: a systematic survey of explanatory notes shows more guidance is needed

doi:10.1016/j.jclinepi.2015.12.008

. 2016 Jun:74:19-27.

doi: 10.1016/j.jclinepi.2015.12.008. Epub 2016 Jan 11.

Improving GRADE evidence tables part 2: a systematic survey of explanatory notes shows more guidance is needed

Affiliations

¹ Department of Clinical Epidemiology, Biostatistics and Bioinformatics, Academic Medical Center, University of Amsterdam, PO Box 22660, J1B-211, 1100 DD Amsterdam, The Netherlands.
² Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Department of Oral and Maxillofacial Surgery, Faculty of Dentistry, Universidad de Chile, Sergio Livingstone Pohlhammer 943, Independencia, Santiago, Chile; Evidence-Based Dentistry Unit, Faculty of Dentistry, Universidad de Chile, Sergio Livingstone Pohlhammer 943, Independencia, Santiago, Chile.
³ Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada.
⁴ Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Department of Medicine, University of Missouri, 2411 Holmes St., Kansas City, MO 64108-2792, USA; Department of Biomedical and Health Informatics, University of Missouri, 2411 Holmes St., Kansas City, MO 64108-2792, USA.
⁵ Evidence-Based Dentistry Unit, Faculty of Dentistry, Universidad de Chile, Sergio Livingstone Pohlhammer 943, Independencia, Santiago, Chile; Institute of Health Policy, Management and Evaluation, University of Toronto, 155 College St, 4th Floor, Toronto, Ontario M5T 3M6, Canada.
⁶ Dutch Cochrane Centre, Julius Center-UMC Utrecht, Huispostnummer Str. 6.131, Postbus 85500, 3508 GA Utrecht.
⁷ Cochrane Editorial Unit, St Albans House, 57-59 Haymarket, London SW1Y 4QX, United Kingdom.
⁸ Nordic Cochrane Centre, Blegdamsvej 9, 7811, 2100 Copenhagen, Denmark.
⁹ Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Department of Medicine, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada.
¹⁰ Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Department of Medicine, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Cochrane Applicability and Recommendations Methods Group, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; McMaster GRADE Center, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada. Electronic address: schuneh@mcmaster.ca.

PMID: 26791431
DOI: 10.1016/j.jclinepi.2015.12.008

Improving GRADE evidence tables part 2: a systematic survey of explanatory notes shows more guidance is needed

Miranda Langendam et al. J Clin Epidemiol. 2016 Jun.

. 2016 Jun:74:19-27.

doi: 10.1016/j.jclinepi.2015.12.008. Epub 2016 Jan 11.

Affiliations

¹ Department of Clinical Epidemiology, Biostatistics and Bioinformatics, Academic Medical Center, University of Amsterdam, PO Box 22660, J1B-211, 1100 DD Amsterdam, The Netherlands.
² Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Department of Oral and Maxillofacial Surgery, Faculty of Dentistry, Universidad de Chile, Sergio Livingstone Pohlhammer 943, Independencia, Santiago, Chile; Evidence-Based Dentistry Unit, Faculty of Dentistry, Universidad de Chile, Sergio Livingstone Pohlhammer 943, Independencia, Santiago, Chile.
³ Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada.
⁴ Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Department of Medicine, University of Missouri, 2411 Holmes St., Kansas City, MO 64108-2792, USA; Department of Biomedical and Health Informatics, University of Missouri, 2411 Holmes St., Kansas City, MO 64108-2792, USA.
⁵ Evidence-Based Dentistry Unit, Faculty of Dentistry, Universidad de Chile, Sergio Livingstone Pohlhammer 943, Independencia, Santiago, Chile; Institute of Health Policy, Management and Evaluation, University of Toronto, 155 College St, 4th Floor, Toronto, Ontario M5T 3M6, Canada.
⁶ Dutch Cochrane Centre, Julius Center-UMC Utrecht, Huispostnummer Str. 6.131, Postbus 85500, 3508 GA Utrecht.
⁷ Cochrane Editorial Unit, St Albans House, 57-59 Haymarket, London SW1Y 4QX, United Kingdom.
⁸ Nordic Cochrane Centre, Blegdamsvej 9, 7811, 2100 Copenhagen, Denmark.
⁹ Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Department of Medicine, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada.
¹⁰ Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Department of Medicine, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Cochrane Applicability and Recommendations Methods Group, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; McMaster GRADE Center, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada. Electronic address: schuneh@mcmaster.ca.

PMID: 26791431
DOI: 10.1016/j.jclinepi.2015.12.008

Abstract

Objectives: The Grading of Recommendations Assessment, Development, and Evaluation (GRADE) working group has developed GRADE evidence profiles (EP) and summary of findings (SoF) tables to present evidence summaries in systematic reviews, clinical guidelines, and health technology assessments. Explanatory notes are used to explain choices and judgments in these summaries, for example, on rating of the quality of evidence.

Study design and setting: A systematic survey of the explanations in SoF tables in 132 randomly selected Cochrane Intervention reviews and in EPs of 10 guidelines. We analyzed the content of 1,291 explanations using a predefined list of criteria.

Results: Most explanations were used to describe or communicate results and to explain downgrading of the quality of evidence, in particular for risk of bias and imprecision. Addressing the source of baseline risk (observational data or control group risk) was often missing. For judgments about downgrading the quality of evidence, the percentage of informative explanations ranged between 41% (imprecision) and 79% (indirectness).

Conclusion: We found that by and large explanations were informative but detected several areas for improvement (e.g., source of baseline risk and judgments on imprecision). Guidance about explanatory footnotes and comments will be provided in the last article in this series.

Keywords: GRADE; GRADEpro; Health technology assessment; Quality of evidence; Risk of bias; Summary of findings tables; Systematic reviews.

PubMed Disclaimer

Cited by

Facilitating healthcare decisions by assessing the certainty in the evidence from preclinical animal studies.
Hooijmans CR, de Vries RBM, Ritskes-Hoitinga M, Rovers MM, Leeflang MM, IntHout J, Wever KE, Hooft L, de Beer H, Kuijpers T, Macleod MR, Sena ES, Ter Riet G, Morgan RL, Thayer KA, Rooney AA, Guyatt GH, Schünemann HJ, Langendam MW; GRADE Working Group. Hooijmans CR, et al. PLoS One. 2018 Jan 11;13(1):e0187271. doi: 10.1371/journal.pone.0187271. eCollection 2018. PLoS One. 2018. PMID: 29324741 Free PMC article. Review.
A systematic review and meta-analysis of randomized trials of substituting soymilk for cow's milk and intermediate cardiometabolic outcomes: understanding the impact of dairy alternatives in the transition to plant-based diets on cardiometabolic health.
Erlich MN, Ghidanac D, Blanco Mejia S, Khan TA, Chiavaroli L, Zurbau A, Ayoub-Charette S, Almneni A, Messina M, Leiter LA, Bazinet RP, Jenkins DJA, Kendall CWC, Sievenpiper JL. Erlich MN, et al. BMC Med. 2024 Aug 22;22(1):336. doi: 10.1186/s12916-024-03524-7. BMC Med. 2024. PMID: 39169353 Free PMC article.
Nordic dietary patterns and cardiometabolic outcomes: a systematic review and meta-analysis of prospective cohort studies and randomised controlled trials.
Massara P, Zurbau A, Glenn AJ, Chiavaroli L, Khan TA, Viguiliouk E, Mejia SB, Comelli EM, Chen V, Schwab U, Risérus U, Uusitupa M, Aas AM, Hermansen K, Thorsdottir I, Rahelić D, Kahleová H, Salas-Salvadó J, Kendall CWC, Sievenpiper JL. Massara P, et al. Diabetologia. 2022 Dec;65(12):2011-2031. doi: 10.1007/s00125-022-05760-z. Epub 2022 Aug 26. Diabetologia. 2022. PMID: 36008559 Free PMC article.
Development and use of health outcome descriptors: a guideline development case study.
Baldeh T, Saz-Parkinson Z, Muti P, Santesso N, Morgano GP, Wiercioch W, Nieuwlaat R, Gräwingholt A, Broeders M, Duffy S, Hofvind S, Nystrom L, Ioannidou-Mouzaka L, Warman S, McGarrigle H, Knox S, Fitzpatrick P, Rossi PG, Quinn C, Borisch B, Lebeau A, de Wolf C, Langendam M, Piggott T, Giordano L, van Landsveld-Verhoeven C, Bernier J, Rabe P, Schünemann HJ. Baldeh T, et al. Health Qual Life Outcomes. 2020 Jun 5;18(1):167. doi: 10.1186/s12955-020-01338-8. Health Qual Life Outcomes. 2020. PMID: 32503619 Free PMC article.

Publication types

Actions

MeSH terms

Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions

LinkOut - more resources

Full Text Sources
- ClinicalKey
- Elsevier Science
Other Literature Sources
- scite Smart Citations

Save citation to file

Email citation

Add to Collections

Add to My Bibliography

Your saved search

Create a file for external citation management software

Your RSS Feed

Improving GRADE evidence tables part 2: a systematic survey of explanatory notes shows more guidance is needed

Affiliations

Improving GRADE evidence tables part 2: a systematic survey of explanatory notes shows more guidance is needed

Authors

Affiliations

Abstract

Similar articles

Cited by

Publication types

MeSH terms

LinkOut - more resources

Full Text Sources

Other Literature Sources