Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Nov;41(11):3149-3153.
doi: 10.1007/s00345-023-04563-0. Epub 2023 Aug 26.

ChatGPT and most frequent urological diseases: analysing the quality of information and potential risks for patients

Juliusz Jan Szczesniewski  1   2 , Carlos Tellez Fouz  3 , Alejandra Ramos Alba  4   5 , Francisco Javier Diaz Goizueta  3 , Ana García Tello  3 , Luis Llanes González  3   6
Affiliations

ChatGPT and most frequent urological diseases: analysing the quality of information and potential risks for patients

Juliusz Jan Szczesniewski et al. World J Urol. 2023 Nov.

Abstract

Purpose: Artificial intelligence (AI) is a set of systems or combinations of algorithms, which mimic human intelligence. ChatGPT is software with artificial intelligence which was recently developed by OpenAI. One of its potential uses could be to consult the information about pathologies and treatments. Our objective was to assess the quality of the information provided by AI like ChatGPT and establish if it is a secure source of information for patients.

Methods: Questions about bladder cancer, prostate cancer, renal cancer, benign prostatic hypertrophy (BPH), and urinary stones were queried through ChatGPT 4.0. Two urologists analysed the responses provided by ChatGPT using DISCERN questionary and a brief instrument for evaluating the quality of informed consent documents.

Results: The overall information provided in all pathologies was well-balanced. In each pathology was explained its anatomical location, affected population and a description of the symptoms. It concluded with the established risk factors and possible treatment. All treatment answers had a moderate quality score with DISCERN (3 of 5 points). The answers about surgical options contain the recovery time, type of anaesthesia, and potential complications. After analysing all the responses related to each disease, all pathologies except BPH achieved a DISCERN score of 4.

Conclusions: ChatGPT information should be used with caution since the chatbot does not disclose the sources of information and may contain bias even with simple questions related to the basics of urologic diseases.

Keywords: Artificial intelligence; ChatGPT; Patient information; Quality of information; Urology.

PubMed Disclaimer

Comment in

References

    1. OpenAI Help Center ChatGPT general FAQ. https://help.openai.com/en/articles/6783457-chatgpt-general-faq . Accessed 9 Mar 2023
    1. Fraser H, Coiera E, Wong D (2018) Safety of patient-facing digital symptom checkers. Lancet 392(10161):2263–2264. https://doi.org/10.1016/S0140-6736(18)32819-8 - DOI - PubMed
    1. Loeb S, Sengupta S, Butaney M et al (2019) Dissemination of misinformative and biased information about prostate cancer on YouTube. Eur Urol 75(4):564–567. https://doi.org/10.1016/j.eururo.2018.10.056 - DOI - PubMed
    1. Loeb S, Reines K, Abu-Salha Y et al (2021) Quality of bladder cancer information on YouTube. Eur Urol 79(1):56–59. https://doi.org/10.1016/j.eururo.2020.09.014 - DOI - PubMed
    1. Betschart P, Pratsinis M, Müllhaupt G et al (2020) Information on surgical treatment of benign prostatic hyperplasia on YouTube is highly biased and misleading. BJU Int 125(4):595–601. https://doi.org/10.1111/bju.14971 - DOI - PubMed

LinkOut - more resources