Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Nov 24;408(1):446.
doi: 10.1007/s00423-023-03173-z.

Delving into New Frontiers: assessing ChatGPT's proficiency in revealing uncharted dimensions of general surgery and pinpointing innovations for future advancements

Bryan Lim  1   2 , Ishith Seth  3   4   5 , Dilshad Dooreemeah  5 , Chun Hin Angus Lee  5
Affiliations

Delving into New Frontiers: assessing ChatGPT's proficiency in revealing uncharted dimensions of general surgery and pinpointing innovations for future advancements

Bryan Lim et al. Langenbecks Arch Surg. .

Abstract

Purpose: The advent of artificial intelligence (AI) has significantly influenced various medical domains, including general surgery. This research aims to assess ChatGPT, an AI language model, in its ability to shed light on the historical facets of general surgery and pinpoint opportunities for innovation.

Methods: A series of 7 pertinent questions on field of general surgery was posed to ChatGPT. The AI-generated responses were meticulously examined for their relevance, accuracy, and novelty. Additionally, the study explored the AI's ability to recognize knowledge gaps and propose inventive solutions. Expert general surgeons and general surgical residents possessing comprehensive research experience assessed ChatGPT's answers by comparing them to established guidelines and existing literature.

Results: ChatGPT presented information that was relevant and accurate, albeit superficial. However, it exhibited convergent thinking and was unable to produce truly groundbreaking ideas to transform general surgery. Instead, it pointed to current popular trends with significant potential for further development. It failed to provide references when prompted and even created references that could not be verified in exhibiting databases.

Conclusion: While ChatGPT demonstrated a comprehensive understanding of existing general surgical knowledge and the capacity to generate relevant, evidence-based material, it displayed limitations in producing truly groundbreaking concepts or discoveries beyond current knowledge. These results highlight the necessity of enhancing AI-driven models to facilitate the emergence of new insights and promote synergistic, human-AI partnerships for expediting advancements within the general surgery domain.

Keywords: Artificial intelligence; ChatGPT; General surgery; Innovation.

PubMed Disclaimer

References

    1. Hamet P, Tremblay J (2017) Artificial intelligence in medicine. Metabolism 69:S36–S40. https://doi.org/10.1016/j.metabol.2017.01.011 - DOI
    1. Seth I, Rodwell A, Tso R, Valles J, Bulloch G, Seth N (2023) A conversation with an open artificial intelligence platform on osteoarthritis of the hip and treatment. J Ortho Sports Med 5:112–120. https://doi.org/10.26502/josm.511500088 - DOI
    1. Cox A, Seth I, Xie Y, Hunter-Smith DJ, Rozen WM (2023) Utilizing ChatGPT-4 for providing medical information on blepharoplasties to patients. Aesthetic Surg J 43:sjad096. https://doi.org/10.1093/asj/sjad096 - DOI
    1. Meyer JG, Urbanowicz RJ, Martin PCN et al (2023) ChatGPT and large language models in academica: opportunities and challenges. BioData Mining 16:20. https://doi.org/10.1186/s13040-023-00339-9 - DOI - PubMed - PMC
    1. Kasneci E, Sessler K, Küchemann, et al (2023) ChatGPT for good? On opportunities and challenges of large language models for education. Learning Individ Differ 103:102274. https://doi.org/10.1016/j.lindif.2023.102274 - DOI

LinkOut - more resources