Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Dec;167(3):1004-1009.
doi: 10.1002/ijgo.15751. Epub 2024 Jun 30.

The future of patient education: A study on AI-driven responses to urinary incontinence inquiries

Reut Rotem  1   2 , Omri Zamstein  3 , Misgav Rottenstreich  2 , Orfhlaith E O'Sullivan  1 , Barry A O'reilly  1 , Adi Y Weintraub  3
Affiliations

The future of patient education: A study on AI-driven responses to urinary incontinence inquiries

Reut Rotem et al. Int J Gynaecol Obstet. 2024 Dec.

Abstract

Objective: To evaluate the effectiveness of ChatGPT in providing insights into common urinary incontinence concerns within urogynecology. By analyzing the model's responses against established benchmarks of accuracy, completeness, and safety, the study aimed to quantify its usefulness for informing patients and aiding healthcare providers.

Methods: An expert-driven questionnaire was developed, inviting urogynecologists worldwide to assess ChatGPT's answers to 10 carefully selected questions on urinary incontinence (UI). These assessments focused on the accuracy of the responses, their comprehensiveness, and whether they raised any safety issues. Subsequent statistical analyses determined the average consensus among experts and identified the proportion of responses receiving favorable evaluations (a score of 4 or higher).

Results: Of 50 urogynecologists that were approached worldwide, 37 responded, offering insights into ChatGPT's responses on UI. The overall feedback averaged a score of 4.0, indicating a positive acceptance. Accuracy scores averaged 3.9 with 71% rated favorably, whereas comprehensiveness scored slightly higher at 4 with 74% favorable ratings. Safety assessments also averaged 4 with 74% favorable responses.

Conclusion: This investigation underlines ChatGPT's favorable performance across the evaluated domains of accuracy, comprehensiveness, and safety within the context of UI queries. However, despite this broadly positive reception, the study also signals a clear avenue for improvement, particularly in the precision of the provided information. Refining ChatGPT's accuracy and ensuring the delivery of more pinpointed responses are essential steps forward, aiming to bolster its utility as a comprehensive educational resource for patients and a supportive tool for healthcare practitioners.

Keywords: ChatGPT; Urogynecology; artificial intelligence‐generated responses; expert opinions; quality evaluation; urinary incontinence.

PubMed Disclaimer

References

REFERENCES

    1. Reynolds WS , Dmochowski RR , Penson DF . Epidemiology of stress urinary incontinence in women. Curr Urol Rep. 2011;12:370‐376. doi:10.1007/S11934-011-0206-0
    1. Game X , Dmochowski R , Robinson D . Mixed urinary incontinence: are there effective treatments? Neurourol Urodyn. 2023;42:401‐408. doi:10.1002/nau.25065
    1. Kenton KS , Smilen SW , ACOG Practice Bulletin No. 155: urinary incontinence in women. Obstet Gynecol. 2015;126:E66‐E81. doi:10.1097/AOG.0000000000001148
    1. Felde G , Engeland A , Hunskaar S . Urinary incontinence associated with anxiety and depression: the impact of psychotropic drugs in a cross‐sectional study from the Norwegian HUNT study. BMC Psychiatry. 2020;20:521. doi:10.1186/S12888-020-02922-4
    1. Schluter PJ , Askew DA , Jamieson HA , Arnold EP . Urinary and fecal incontinence are independently associated with falls risk among older women and men with complex needs: a national population study. Neurourol Urodyn. 2020;39:945‐953. doi:10.1002/NAU.24266

LinkOut - more resources