Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2016 Oct 1;151(10):930-936.
doi: 10.1001/jamasurg.2016.1640.

Defining a Research Agenda for Patient-Reported Outcomes in Surgery: Using a Delphi Survey of Stakeholders

Affiliations

Defining a Research Agenda for Patient-Reported Outcomes in Surgery: Using a Delphi Survey of Stakeholders

Michael L Pezold et al. JAMA Surg. .

Abstract

Importance: Identifying timely and important research questions using relevant patient-reported outcomes (PROs) in surgery remains paramount in the current medical climate. The inaugural Patient-Reported Outcomes in Surgery (PROS) Conference brought together stakeholders in PROs research in surgery with the aim of creating a research agenda to help determine future directions and advance cross-disciplinary collaboration.

Objective: To create a research agenda to help determine future directions and advance cross-disciplinary collaboration on the use of PROs in surgery.

Design, setting, and participants: An iterative web-based interface was used to create a conference-based, modified Delphi survey for registrants at the PROS Conference (January 29-30, 2015), including surgeons, PRO researchers, payers, and other stakeholders. In round 1, research items were generated from qualitative review of responses to open-ended prompts. In round 2, items were ranked using a 5-point Likert scale; attendees were also asked to submit any new items. In round 3, the top 30 items and newly submitted items were redistributed for final ranking using a 3-point Likert scale. The top 20 items by mean rating were selected for the research agenda.

Main outcomes and measures: An expert-generated research agenda on PROs in surgery.

Results: Of the 143 people registered for the conference, 137 provided valid email addresses. There was a wide range of attendees, with the 3 most common groups being plastic surgeons (28 [19.6%]), general surgeons (19 [13.3%]), and researchers (25 [17.5%]). In round 1, participants submitted 459 items, which were reduced through qualitative review to 53 distinct items across 7 themes of PROs research. A research agenda was formulated after 2 successive rounds of ranking. The research agenda identified 3 themes important for future PROs research in surgery: (1) PROs in the decision-making process, (2) integrating PROs into the electronic health record, and (3) measuring quality in surgery with PROs.

Conclusions and relevance: The PROS Conference research agenda was created using a modified Delphi survey of stakeholders that will help researchers, surgeons, and funders identify crucial areas of future PROs research in surgery.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Flow chart for the three rounds of the modified Delphi survey
Figure 2
Figure 2
Most important themes for PROs research in surgery identified from the Delphi survey

Comment in

Similar articles

  • SAGES research agenda in gastrointestinal and endoscopic surgery: updated results of a Delphi study.
    Stefanidis D, Montero P, Urbach DR, Qureshi A, Perry K, Bachman SL, Madan A, Petersen R, Pryor AD. Stefanidis D, et al. Surg Endosc. 2014 Oct;28(10):2763-71. doi: 10.1007/s00464-014-3535-5. Epub 2014 May 2. Surg Endosc. 2014. PMID: 24789129
  • Defining a Research Agenda for Layperson Prehospital Hemorrhage Control: A Consensus Statement.
    Goralnick E, Ezeibe C, Chaudhary MA, McCarty J, Herrera-Escobar JP, Andriotti T, de Jager E, Ospina-Delgado D, Goolsby C, Hunt R, Weissman JS, Haider A, Jacobs L; Stop the Bleed National Research Agenda Consensus Conference Working Group; Andrade E, Brown J, Bulger EM, Butler FK, Callaway D, Caterson EJ, Choudhry NK, Davis MR, Eastman A, Eastridge BJ, Epstein JL, Evans CL, Gausche-Hill M, Gestring ML, Goldberg SA, Hanfling D, Holcomb JB, Jonson CO, King DR, Kivlehan S, Kotwal RS, Krohmer JR, Levy-Carrick N, Levy M, Meléndez Lugo JJ, Mooney DP, Neal MD, Niskanen R, O'Neill P, Park H, Pons PT, Prytz E, Rasmussen TE, Remley MA, Riviello R, Salim A, Shackelfold S, Smith ER, Stewart RM, Swaroop M, Ward K, Uribe-Leitz T, Jarman MP, Ortega G. Goralnick E, et al. JAMA Netw Open. 2020 Jul 1;3(7):e209393. doi: 10.1001/jamanetworkopen.2020.9393. JAMA Netw Open. 2020. PMID: 32663307
  • Development of ASMBS research agenda for bariatric surgery using the Delphi methodology.
    Stefanidis D, King WC, Puzziferri N, Butler AR, Hutter M, Sudan R. Stefanidis D, et al. Surg Obes Relat Dis. 2019 Sep;15(9):1563-1569. doi: 10.1016/j.soard.2019.06.043. Epub 2019 Jul 8. Surg Obes Relat Dis. 2019. PMID: 31466874
  • Ethical Considerations for the Inclusion of Patient-Reported Outcomes in Clinical Research: The PRO Ethics Guidelines.
    Cruz Rivera S, Aiyegbusi OL, Ives J, Draper H, Mercieca-Bebber R, Ells C, Hunn A, Scott JA, Fernandez CV, Dickens AP, Anderson N, Bhatnagar V, Bottomley A, Campbell L, Collett C, Collis P, Craig K, Davies H, Golub R, Gosden L, Gnanasakthy A, Haf Davies E, von Hildebrand M, Lord JM, Mahendraratnam N, Miyaji T, Morel T, Monteiro J, Zwisler AO, Peipert JD, Roydhouse J, Stover AM, Wilson R, Yap C, Calvert MJ. Cruz Rivera S, et al. JAMA. 2022 May 17;327(19):1910-1919. doi: 10.1001/jama.2022.6421. JAMA. 2022. PMID: 35579638
  • Identifying a Core Domain Set to Assess Psoriasis in Clinical Trials.
    Callis Duffin K, Merola JF, Christensen R, Latella J, Garg A, Gottlieb AB, Armstrong AW. Callis Duffin K, et al. JAMA Dermatol. 2018 Oct 1;154(10):1137-1144. doi: 10.1001/jamadermatol.2018.1165. JAMA Dermatol. 2018. PMID: 29874367 Free PMC article.

Cited by

References

    1. Food and Drug Administration (US) Guidance for Industry. Patient Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims. Fed Regist. 2009;74(235):65132–65133. - PubMed
    1. Basch E, Jia X, Heller G, et al. Adverse symptom event reporting by patients vs clinicians: Relationships with clinical outcomes. J Natl Cancer Inst. 2009;101(23):1624–1632. - PMC - PubMed
    1. Möller E, Weidenhielm L, Werner S. Outcome and knee-related quality of life after anterior cruciate ligament reconstruction: a long-term follow-up. Knee Surg Sports Traumatol Arthrosc. 2009;17(7):786–794. - PubMed
    1. Pusic AL, Klassen AF, Scott AM, Klok JA, Cordeiro PG, Cano SJ. Development of a new patient-reported outcome measure for breast surgery: the BREAST-Q. Plast Reconstr Surg. 2009;124(2):345–353. - PubMed
    1. Frobell RB, Roos HP, Roos EM, Roemer FW, Ranstam J, Lohmander LS. Treatment for acute anterior cruciate ligament tear: five year outcome of randomised trial. BMJ. 2013;346(7895):f232. - PMC - PubMed

Publication types