Synthesis, grading, and presentation of evidence in guidelines: article 7 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report

Abstract

Introduction: Professional societies, like many other organizations around the world, have recognized the need to use more rigorous processes to ensure that health care recommendations are informed by the best available research evidence. This is the seventh of a series of 14 articles that were prepared to advise guideline developers in respiratory and other diseases on approaches for guideline development. This article focuses on synthesizing, rating, and presenting evidence in guidelines.

Methods: In this review we addressed the following questions. (1) What evidence should guideline panels use to inform their recommendations? (2) How should they rate the quality of the evidence they use? (3) How should they grade evidence regarding diagnostic tests? (4) What should they do when quality of evidence differs across outcomes? (5) How should they present the evidence in a guideline? We did not conduct systematic reviews ourselves. We relied on prior evaluations of electronic databases and systematic reviews suggesting that the Grades of Recommendation, Assessment, Development and Evaluation Working Group (GRADE) approach includes the desired features of a system for grading quality of evidence, including provision of models for presenting evidence for guideline panels, and for the consumers of practice guidelines. This article describes the GRADE approach to grading the quality of evidence and presenting evidence. Available evidence, the practice of leading guideline developers, and workshop discussions provide the basis for our conclusions.

Results and discussion: GRADE rates the quality of evidence for each outcome across studies rather than for each study. In the GRADE approach randomized trials start as high-quality evidence and observational studies as low-quality evidence, but both can be rated down or up. Five factors may lead to rating down the quality of evidence: study limitations or risk of bias, inconsistency of results, indirectness of evidence, imprecision, and publication bias. Three factors may lead to rating up the quality of evidence from observational studies: large magnitude of effect, dose-response gradient, and situations in which all plausible confounders would decrease an apparent treatment effect, or would create a spurious effect when results suggest no effect. GRADE suggests use of evidence profiles that provide a comprehensive way to display the key evidence relevant to a clinical question. Guideline developers who follow this structure will find the transparency of their recommendations markedly enhanced.