Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2021 Jul 20;11(4):116-129.
doi: 10.5662/wjm.v11.i4.116.

Delphi methodology in healthcare research: How to decide its appropriateness

Prashant Nasa  1 , Ravi Jain  2 , Deven Juneja  3
Affiliations
Review

Delphi methodology in healthcare research: How to decide its appropriateness

Prashant Nasa et al. World J Methodol. .

Abstract

The Delphi technique is a systematic process of forecasting using the collective opinion of panel members. The structured method of developing consensus among panel members using Delphi methodology has gained acceptance in diverse fields of medicine. The Delphi methods assumed a pivotal role in the last few decades to develop best practice guidance using collective intelligence where research is limited, ethically/logistically difficult or evidence is conflicting. However, the attempts to assess the quality standard of Delphi studies have reported significant variance, and details of the process followed are usually unclear. We recommend systematic quality tools for evaluation of Delphi methodology; identification of problem area of research, selection of panel, anonymity of panelists, controlled feedback, iterative Delphi rounds, consensus criteria, analysis of consensus, closing criteria, and stability of the results. Based on these nine qualitative evaluation points, we assessed the quality of Delphi studies in the medical field related to coronavirus disease 2019. There was inconsistency in reporting vital elements of Delphi methods such as identification of panel members, defining consensus, closing criteria for rounds, and presenting the results. We propose our evaluation points for researchers, medical journal editorial boards, and reviewers to evaluate the quality of the Delphi methods in healthcare research.

Keywords: Consensus; Coronavirus disease 2019; Delphi studies; Delphi technique; Expert panel; Quality tools for methodology; Research methods; SARS-CoV-2.

PubMed Disclaimer

Conflict of interest statement

Conflict-of-interest statement: Prashant Nasa declared to be on the advisory board of Edwards life sciences. Other authors do not declare any conflict of interest.

Figures

Figure 1
Figure 1
Stepwise quality assessment of Delphi studies.
Figure 2
Figure 2
Stability assessment for Delphi rounds.
See this image and copyright information in PMC

References

    1. Linstone HA, Turoff M. The Delphi Method: Techniques and Applications, 1975. Available from: https://web.njit.edu/~turoff/pubs/delphibook/ch1.html .
    1. Dalkey N, Helmer O. An Experimental Application of the DELPHI Method to the Use of Experts. Manag Sci. 1963;9:458–467.
    1. Goodman CM. The Delphi technique: a critique. J Adv Nurs. 1987;12:729–734. - PubMed
    1. McGrath BA, Brenner MJ, Warrillow SJ, Pandian V, Arora A, Cameron TS, Añon JM, Hernández Martínez G, Truog RD, Block SD, Lui GCY, McDonald C, Rassekh CH, Atkins J, Qiang L, Vergez S, Dulguerov P, Zenk J, Antonelli M, Pelosi P, Walsh BK, Ward E, Shang Y, Gasparini S, Donati A, Singer M, Openshaw PJM, Tolley N, Markel H, Feller-Kopman DJ. Tracheostomy in the COVID-19 era: global and multidisciplinary guidance. Lancet Respir Med. 2020;8:717–725. - PMC - PubMed
    1. Jünger S, Payne S, Brearley S, Ploenes V, Radbruch L. Consensus building in palliative care: a Europe-wide delphi study on common understandings and conceptual differences. J Pain Symptom Manage. 2012;44:192–205. - PubMed