Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 May 30;9(1):44.
doi: 10.1038/s41523-023-00557-8.

Large language model (ChatGPT) as a support tool for breast tumor board

Vera Sorin  1   2   3 , Eyal Klang  4   5   6   7 , Miri Sklair-Levy  4   5 , Israel Cohen  4   5 , Douglas B Zippel  5   8 , Nora Balint Lahat  5   9 , Eli Konen  4   5 , Yiftach Barash  4   5   6
Affiliations

Large language model (ChatGPT) as a support tool for breast tumor board

Vera Sorin et al. NPJ Breast Cancer. .

Abstract

Large language models (LLM) such as ChatGPT have gained public and scientific attention. The aim of this study is to evaluate ChatGPT as a support tool for breast tumor board decisions making. We inserted into ChatGPT-3.5 clinical information of ten consecutive patients presented in a breast tumor board in our institution. We asked the chatbot to recommend management. The results generated by ChatGPT were compared to the final recommendations of the tumor board. They were also graded independently by two senior radiologists. Grading scores were between 1-5 (1 = completely disagree, 5 = completely agree), and in three different categories: summarization, recommendation, and explanation. The mean age was 49.4, 8/10 (80%) of patients had invasive ductal carcinoma, one patient (1/10, 10%) had a ductal carcinoma in-situ and one patient (1/10, 10%) had a phyllodes tumor with atypia. In seven out of ten cases (70%), ChatGPT's recommendations were similar to the tumor board's decisions. Mean scores while grading the chatbot's summarization, recommendation and explanation by the first reviewer were 3.7, 4.3, and 4.6 respectively. Mean values for the second reviewer were 4.3, 4.0, and 4.3, respectively. In this proof-of-concept study, we present initial results on the use of an LLM as a decision support tool in a breast tumor board. Given the significant advancements, it is warranted for clinicians to be familiar with the potential benefits and harms of the technology.

PubMed Disclaimer

Conflict of interest statement

The authors declare no competing interests.

Figures

Fig. 1
Fig. 1
Rating of the performance of a large langue model (ChatGPT) in three categories by the two reviewers (M.S.L. – reviewer-1 in gray and Ey.K. – reviewer-2 in black): summarization of text, clinical recommendation, and explanation on the decision made.
See this image and copyright information in PMC

References

    1. Sorin V, Barash Y, Konen E, Klang E. Deep-learning natural language processing for oncological applications. Lancet Oncol. 2020;21:1553–1556. doi: 10.1016/S1470-2045(20)30615-X. - DOI - PubMed
    1. Sorin, V., Barash Y., Konen E., Klang E. Large language models for oncological applications. J. Cancer Res. Clin. Oncol.10.1007/s00432-023-04824-w. - PMC - PubMed
    1. Kung TH, et al. Performance of ChatGPT on USMLE: Potential for AI-Assisted Medical Education Using Large Language Models. PLOS Digital Health. 2023;2:e0000198. doi: 10.1371/journal.pdig.0000198. - DOI - PMC - PubMed
    1. Jeblick K., et al. ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reports. Preprint at: http://arXiv preprint arXiv:2212.14882 (2022). - PMC - PubMed
    1. Rao A., et al. Evaluating ChatGPT as an Adjunct for Radiologic Decision-Making. Preprint at: https://www.medrxiv.org/content/10.1101/2023.02.02.23285399v1 (2023). - DOI