Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2010 Aug 30:3:225-30.
doi: 10.2147/ijgm.s11117.

The Delphi process: a solution for reviewing novel grant applications

Cath Holliday  1 , Monica Robotin
Affiliations

The Delphi process: a solution for reviewing novel grant applications

Cath Holliday et al. Int J Gen Med. .

Abstract

Introduction: Traditional scientific review processes are not well suited for evaluating the merits of research in situations where the available scientific evidence is limited and if review panels have widely divergent opinions. This study tested whether a Delphi process is useful in grant selection.

Materials and method: A Delphi process prioritized novel research proposals in pancreatic cancer. Five reviewers holding similar grants overseas ranked research applications by scientific merit, innovativeness, and level of risk.

Result: Three rounds of voting evaluated the best 10 applications received. In the first round of the Delphi process, scores ranged from 5.0 to 8.3. After the second round, the cumulative scores of the eight remaining applications ranged from 10 to 12.6. At the end of the third round, the final cumulative scores of the remaining six applications ranged from 13.6 to 18.2. The four highest ranking applications were recommended for funding, with agreement from reviewers.

Conclusion: A modified Delphi process proved to be an efficient, transparent, and equitable method of reviewing novel grant applications in a specialized field of research, where no local expertise was available. This process may also be useful for other peer review processes, particularly where there is limited access to local experts.

Keywords: consensus; delphi process; research grant selection.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Diagrammatic representation of the Delphi grant process.
See this image and copyright information in PMC

References

    1. Murphy MK, Black NA, Lamping DL, et al. Consensus development methods, and their use in clinical guideline development. Health Technol Assess. 1998;2(3):1–88. - PubMed
    1. Turoff M. The policy Delphi. In: HA Linstone MT, editor. The Delphi Method: Techniques and Applications. Boston, MA: Addison-Wesley Publishing Co; 1975.
    1. Fink A, Kosecoff J, Chassin M, Brook RH. Consensus methods: Characteristics and guidelines for use. Am J Public Health. 1984;74(9):979–983. - PMC - PubMed
    1. Cross H. Consensus methods: A bridge between clinical reasoning and clinical research? Int J Lepr Other Mycobact Dis. 2005;73(1):28–32. - PubMed
    1. Gagliardi AR, Lemieux-Charles L, Brown AD, Sullivan T, Goel V. Barriers to patient involvement in health service planning and evaluation: An exploratory study. Patient Educ Couns. 2008;70(2):234–241. - PubMed