Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Sep 6;16(9):e68808.
doi: 10.7759/cureus.68808. eCollection 2024 Sep.

Evaluation of ChatGPT-4's Performance in Therapeutic Decision-Making During Multidisciplinary Oncology Meetings for Head and Neck Squamous Cell Carcinoma

Kenza Alami  1 , Esther Willemse  2 , Marie Quiriny  2 , Samuel Lipski  2 , Celine Laurent  3   4 , Vincent Donquier  2 , Antoine Digonnet  2
Affiliations

Evaluation of ChatGPT-4's Performance in Therapeutic Decision-Making During Multidisciplinary Oncology Meetings for Head and Neck Squamous Cell Carcinoma

Kenza Alami et al. Cureus. .

Abstract

Objectives First reports suggest that artificial intelligence (AI) such as ChatGPT-4 (Open AI, ChatGPT-4, San Francisco, USA) might represent reliable tools for therapeutic decisions in some medical conditions. This study aims to assess the decisional capacity of ChatGPT-4 in patients with head and neck carcinomas, using the multidisciplinary oncology meeting (MOM) and the National Comprehensive Cancer Network (NCCN) decision as references. Methods This retrospective study included 263 patients with squamous cell carcinoma of the oral cavity, oropharynx, hypopharynx, and larynx who were followed at our institution between January 1, 2016, and December 31, 2021. The recommendation of GPT4 for the first- and second-line treatments was compared to the MOM decision and NCCN guidelines. The degrees of agreement were calculated using the Kappa method, which measures the degree of agreement between two evaluators. Results ChatGPT-4 demonstrated a moderate agreement in first-line treatment recommendations (Kappa = 0.48) and a substantial agreement (Kappa = 0.78) in second-line treatment recommendations compared to the decisions from MOM. A substantial agreement with the NCCN guidelines for both first- and second-line treatments was observed (Kappa = 0.72 and 0.66, respectively). The degree of agreement decreased when the decision included gastrostomy, patients over 70, and those with comorbidities. Conclusions The study illustrates that while ChatGPT-4 can significantly support clinical decision-making in oncology by aligning closely with expert recommendations and established guidelines, ongoing enhancements and training are crucial. The findings advocate for the continued evolution of AI tools to better handle the nuanced aspects of patient health profiles, thus broadening their applicability and reliability in clinical practice.

Keywords: artificial intelligence chatgpt-4; ent - ear nose and throat; head and neck squamous cell carcinoma (hnscc); multidisciplinary oncologic meeting; oral oncology.

PubMed Disclaimer

Conflict of interest statement

Human subjects: Consent was obtained or waived by all participants in this study. Jules Bordet Institute issued approval CE3827. Animal subjects: All authors have confirmed that this study did not involve animal subjects or tissue. Conflicts of interest: In compliance with the ICMJE uniform disclosure form, all authors declare the following: Payment/services info: All authors have declared that no financial support was received from any organization for the submitted work. Financial relationships: All authors have declared that they have no financial relationships at present or within the previous three years with any organizations that might have an interest in the submitted work. Other relationships: All authors have declared that there are no other relationships or activities that could appear to have influenced the submitted work.

Figures

Figure 1
Figure 1. Flowchart
See this image and copyright information in PMC

References

    1. ESPEN guidelines on nutrition in cancer patients. Arends J, Bachmann P, Baracos V, et al. Clin Nutr. 2017;36:11–48. - PubMed
    1. Decision making in surgical oncology. Lamb B, Green JS, Vincent C, Sevdalis N. Surg Oncol. 2011;20:163–168. - PubMed
    1. Overview of glottic laryngeal cancer treatment recommendation changes in the NCCN guidelines from 2011 to 2022. Arboleda LP, Neves AB, Kohler HF, et al. Cancer Rep (Hoboken) 2023;6:0. - PMC - PubMed
    1. Updated National Comprehensive Cancer Network guidelines for treatment of head and neck cancers 2010-2017. Wierzbicka M, Napierała J. Otolaryngol Pol. 2017;71:1–6. - PubMed
    1. A meta-analysis of Watson for Oncology in clinical application. Jie Z, Zhiying Z, Li L. Sci Rep. 2021;11:5792. - PMC - PubMed

LinkOut - more resources