Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Nov 2:17:2459-2464.
doi: 10.2147/CCID.S478309. eCollection 2024.

AI in Hidradenitis Suppurativa: Expert Evaluation of Patient-Facing Information

Anne-Cécile Ezanno  1 , Anne-Claire Fougerousse  2 , Christelle Pruvost-Balland  3 , François Maccari  4 , Charlotte Fite  5 ; ResoVerneuil
Affiliations

AI in Hidradenitis Suppurativa: Expert Evaluation of Patient-Facing Information

Anne-Cécile Ezanno et al. Clin Cosmet Investig Dermatol. .

Abstract

Purpose: This study investigates the accuracy of Artificial Intelligence (AI) chatbots, ChatGPT and Bard, in providing information on Hidradenitis Suppurativa (HS), aiming to explore their potential in assisting HS patients by offering insights into symptoms, thus possibly reducing the diagnostic and treatment time gap.

Patients and methods: Using questions formulated with the help of HS patient associations, both ChatGPT and Bard were assessed. Responses to these questions were evaluated by 18 hS experts.

Results: ChatGPT's responses were considered accurate in 86% of cases, significantly outperforming Bard, which only achieved 14% accuracy. Despite the general efficacy of ChatGPT in providing relevant information across a range of HS-related queries, both AI systems showed limitations in offering adequate advice on treatments. The study identifies a significant difference in the performance of the two AIs, emphasizing the need for improvement in AI-driven medical advice, particularly regarding treatment options.

Conclusion: The study highlights the potential of AI chatbots, particularly ChatGPT, in supporting HS patients by improving symptom understanding and potentially reducing the time to diagnosis and treatment. AI chatbots, while promising, cannot yet substitute for professional medical diagnosis and treatment, indicating the importance of enhancing AI capabilities for more accurate and reliable medical information dissemination.

Keywords: acne inversa; artificial intelligence; dermatology; hidradenitis suppurativa.

PubMed Disclaimer

Conflict of interest statement

Dr Anne-Claire Fougerousse reports personal fees, non-financial support from AbbVie, Lilly, Janssen, Leo Pharma, Ucb pharma and Sanofi; personal fees from Novartis, Ammirall, Pfizer, Boehringer Ingelheim and BMS, outside the submitted work. The authors report no conflicts of interest in this work.

Figures

Figure 1
Figure 1
List of the seven queries submitted to ChatGPT and Bard along with their experts’ evaluations.
See this image and copyright information in PMC

References

    1. Loget J, Saint-Martin C, Guillem P, et al. Misdiagnosis of hidradenitis suppurativa continues to be a major issue. The R-ENS Verneuil study. Ann Dermatol Venereol. 2018;145(5):331–338. doi:10.1016/j.annder.2018.01.043 - DOI - PubMed
    1. Sallam M. ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. Healthcare. 2023;11(6):887. doi:10.3390/healthcare11060887 - DOI - PMC - PubMed
    1. Nobles AL, Leas EC, Caputi TL, Zhu SH, Strathdee SA, Ayers JW. Responses to addiction help-seeking from Alexa, Siri, Google Assistant, Cortana, and Bixby intelligent virtual assistants. NPJ Digit Med. 2020;3(1):11. doi:10.1038/s41746-019-0215-9 - DOI - PMC - PubMed
    1. Li J. Security implications of AI chatbots in health care. J Med Internet Res. 2023;25:e47551. doi:10.2196/47551 - DOI - PMC - PubMed
    1. AI Industry Analysis: 50 most visited AI tools and their 24B+ traffic behavior - writerbuddy [internet]. Available from: https://writerbuddy.ai/blog/ai-industry-analysis. Accessed January 7, 2024.

LinkOut - more resources